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PREFACE AND ACKNOWLEDGMENTS 



This Final Report is not a final report in the usual sense of the 
phrase; that is to say, it does not aim to present the full results of 
the work done under the contract. Rather, it is in the form of a 
memorandum concerning the status of this work at the time of submitting 
the report. There are two reasons for not presenting a full final report: 



(l) A number of studies done under this contract have already been 
reported either in full or in part in regular channels of scientific 
communication, either as Journal articles, doctoral dissertations, or 
chapters in books. It would be redundant to include reports of work 
already published. This report will, however, give citations of publi- 
cations so that the reader can find fuller information on the studies 
that have already been reported. In the case of those studies that have 
been only partially reported in print, it will summarize findings that 
remain unpublished and indicate what portions of the studies, if any, 
remain to be completed. 



(2) Despite the long time that has elapsed since the official termi- 
nation of the contract (June 50, 19^0), the principal investigator has 
not had opportunity or funds to complete a number of studies planned in 
the original project proposal. It had been hoped that some of this work 
could be completed, but it is now felt desirable to close out the books 
of the project. This final report will indicate the status of the tin- 
finished substudies. Some of these require only the writing of reports, 
others require considerable analysis of data. It is still hoped that 
some of these studies can be completed even after submission of this 

final report. // 

^ . / 

The original hypothesis of this study was that personality' factors 
play a large role in the developinent of communication skills. In the 
original project proposal, a number of studies were planned in order to 
explore this hypothesis. As so often happens in the conduct of investi- 
gations with large and complex aims, it proved to be difficult to get a 
handle on the problems being investigated. The work was conceived as a 
research program in which a number of basic methodological and substan- 
tive problems would have to be solved before the major hypotheses could 
be attacked. The attention of the investigators tended to be diverted 
into certain channels because of the problems raised by some of the ini- 
tial methodological studies. Because the project supported the work of 
several doctoraD. candidates, the particular interests of these .andidates 
tended to shift its energies in certain directions. There were unexpected 
difficulties in arranging to obtain appropriate experimental subjects or 
sufficient testing time, and in completing computations using high-speed 
computing facilities. (The project was conducted at a time when many com- 
puter programs were Jus - being "debugged," and when rapid development of 
hardware made continuous revision of computer programming necessary. ) 
Hindsight indicates that the contract period of three years was really 
too short to permit completion of the numerous studies originallj’’ planned, 
but for a number of reasons it was not possible to extend the official 
period of the contract nor to obtain additional funds to complete the 
studies. 
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Nevertheless, a number of large and significant studies were completed 
” under this contract— more studies, indeed, than have usually been completed 
under other government contracts of comparable magnitude? Some of these 
• studies represent substantial progress towards achieving the aims of the 
original project proposal# In the Summary, the significance of these 
studies is indicated in more detail. 

As Principal Investigator, I wish to acknowledge the large amount of 
effort and devotion that were put into this project by a number of my col- 
laborators # As research assistants, Michael Marge, Frederic D. Weinfeid, 
and Aaron S. Carton performed major studies which resulted in doctoral 
dissertations. They also helped on various other projedt tasks. The late 
Paul M. Kjeldergaard (deceased January I968), who came into the project as 
Research Associate in its third year, made major contributions to the 
design of studies and helped to complete several important investigations. 
Dr. Robert Gardner, as a Research Associate in the third year of the study, 
helped in initiating and designing certain studies. The contributions of 
Marilyn Brachman, Research Assistant in the first year of the study, and 
of Joan Drues, Research Assistant in the third year of the study, should 
also be acknowledged. 



SUMMABY, a OCCLUSIONS, AND RECOMMENDATIONS 



The results of this investigation can he classified under four head- 
ings; (l) identification of dimensions of ability and ’‘style" in speaking, 
writing, and other kinds of verbal productions; (2) findings concerning 
the relation of these dimensions of ability and "style” to measured per-^ 
sonality characteristics; (5) findings concerning the possible genesis of 
some of these ability and "style" factors in home background and early 
childhood experience; (^) findings concerning the relative effectiveness 
of certain methods of teaching skills in written composition* 



1. Identification of dimensions of ability and "style" in spea^M , 
writing^ and other kinds of verbal production * The bulk of the studies in 
this investigation concerned this area; studies were conducted with dif- 
ferent types of samples of individuals and of verbal productions- 

a* In a study (Study VI in this series ) of tests given to 9th-, 
10th-, and llth-graders, a number of the usually found factors of verbal 
ability were confirmed: Theme-Writing, Ideational Fluency, Verbal Rela- 

tions, Word Fluency, Reasoning, and (probably) Fluency of Expression- 

b. In a study (Study VII ) of tests and ratings by teachers and 
speech specialists of the speech performances of 1^5 eleven-year -olds, a 
number of factors were identified: 



I. General Speaking Ability as assessed by speech 

specialists from recordings of speech performance. 

II. Motor Skill in Speaking. 

III. Speech Dominance: tendency to dominate in verbal 

communication situations. 

IV. Non -Distracting Speech Behavior: avoidance of 

speech characteristics (hesitations, rephrasings, 
etc . ) that draw attention to a communication is 
presented, rather than to its content. 

V. Voice Quality: described by excellence of articula- 

tion, pronunciation and fluency as well as pleasant- 
ness. 

VI. Language Maturity: described by complexity of gram- 

matical usage, and other indicants of level of 
language development. 

VII. General Speaking Ability as assessed by teachers on 
the basis of general classroom observation* 
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c. In a study (Study III) of chai'acteristics of the style ^ of 
150 samples of literary production (authored in most cases by professi^al 
writers), six interpretable factors emerged from a factor analysis of 29 
subjective ratings and 39 objective measures; 

I. Evaluations d' fined by subjective scales such as 
good-bad, uleas ant-unpleasant, strong-weak , and 
intoes ting-boring . 

II. Personal Affect; defined by subjective scales such 
as personal- impersonal, intimate -r emote , emotional - 
ration"al^ and. v igorous-placid, but also by certain 
hbjeHive measures such as number of personal pro- 
nouns . 

III. Ornamentation; defined by subjective scales florid- 
n j wordy-succinct , lush-austere , etco, as well 
as objective variables such as length of sen tences 
and length of clauses . 

IV* Abstractness; defined by sub^sctive scales such as 
sub tie -obvious, abst ract-concrete , and profound- 
superficial as well as objective measures such as a 
low proportion of numerical expressions , a low *,*um- 
ber of determining adjectives and pronouns , and a 
high proportion of noim clauses . 

V. Seriousness; defined by subjective scales earnest- 
f lippant and serious —humorous and by objective indi- 
cators such as a low proportion of i ndefinite 
articles, and a hi^ proportion of indefinite aim 
Quantifying determining adjectives . 

VI* Characterizing vs. Narrating: measured exclusively^ 

by objective indicators; a low proportion of transi 
tive verbs, a high proportion of cop ulative verbs 
relative to all verbs, a low number of proper nouns , 
a high proportion of~ad.iective clauses , and a high 
proportion of intransitive verbs . 



do In a study (Study X) of the style characteristics of n^ra- 

fcives written by more than 200 boys and girls in ^ades 10, , , 

a suburban high school, five of the above stylistic factors were confirmed 

and at least one additional factor was observed; 



I. Evaluation; similar to the factor identified in 
Study IIIo 

II. Personal Affect; similar to the factor identified 
in Study III. 
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III. Ornamentation: similar to the factor identified in 

Study III. 

IV. Abstractness; similar to the factor identified in 
Study III. (identified in only the girls* matrix.) 

V. Seriousness: similar to the factor identified in 

Study III. 

VI. Optimism: defined by scales such as happy-sad, gay- 

morbid, and optimistic-pessimistic . 

In addition there was a doublet having to do with whether evaluations of 
ideas were advanced by the author himself or the characters in his story. 

e. In a study (Study iv) of responses of high school students 
to the Kent-Rosanoff free association test it was established that there 
is a consistent difference among individuals in their tendency to give 
opposite'* or "contrast" responses to stimuli that can evoke such responses; 
the reliability of an "opposite -giving" score was .65 over a l6-month per- 
iod. 



f. In a study (Study II ) of "personality" ratings of l^f speech 
san^les, there was high agreement among raters as to the characteristics 
of the samples. The ratings. inv.cG,v^. attributions of personality char- 
acteristics such as excitable , emotional, insecure, undependable, etc. 

The 14 speech samples were actually taken from recordings made by five 
speakers; three of the speakers, however, recorded under four different 
instructions; "normal, *' "fast," "shouting," and "soft," the presented 
recordings being adjusted to be equal in sound intensity level. There was 
no atten5>t in this study, however, to relate the ratings to any actual per- 
sonality traits of the speakers. 

g. In a study (Study XV) of styles of conceptualization in 

written composition, 10 scales were established: (l) alteristic- 

egoistic; (2) awareness of one's own cognitive processes; (5) tendency 
to evaluate; (4) organization of percepts; (5) progression of organiza- 
tion and analysis; (6) amount of inference; (7) ornamentation (similar 

to factor III in Studies III andX); (8) amount of digression; (9) amount 
of fictionalization; and (lO) specific-general. Reliabilities for ratings 
of these scales averaged over five judges ranged from .46 to .90. 

To su mm a r ize all the above studies, it may be said that many aspects 
of both spoken and written verbal production exhibit "stylistic" or qual- 
itative differences. In some cases, attempts were made to relate such 
stylistic manifestations to actual personality traits of individuals. To 
these studies we now turn. 
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2. Findings concerning the relation of dimensions of ability and 
”s-tyle*‘ to measured personality characteristics » 

a* In the study (Study X) of the style characteristics of nar- 
ratives -written by hi^sh school students, an attempt -was made to find rela- 
tionships between these style characteristics and certain measures of 
personality^-a series of self-ratings on personality scales, and scores 
on two paper-and-pencil personali-fcy inventories, -bhe Guilf ord-Zimme naan 
Temperament Survey (GZTS) and the Minnesota Counseling Inventory (mCI)» 

The results of this attempt were, ho\TOver, almost wholly negative* 

About the oniy relationship found, as reflected by factor loadings, was 
one whereby boys with high scores on Thoughtfulness and Restraint on the 
GZTS had a significant tendency to write themes rated toward the "masculine” 
side of a masculini-ty-femininity scale- 

b. In the study (S-tudy IV) of responses to free -association 
tests, no significant relation was found be-b^een an "opposite-giving" 
tendency and any of the personali-ty measures investigated*. Small but 
significant correlations were found only for girls between the tendency to 
give "primaiy" or popular responses to non-opposite evoking stimuli and 
various tests of verbal ability* 

c- In the study (Study XV) of s-tyles of conceptualization, a 
number of low, but statistically significant, correlations were found 
between conceptualization s-tyles and personality measures. Some of these 
correlations suggested, for exanqple, -that individuals manifesting "organ- 
ization" in their picture descriptions regarded themselves as people who 
intend to organize matters and keep things neat- 

In general, the findings concerning relations between personality 
and "style" characteristics of verba*! productions were disappointingly 
meager. 

3* Findings concerning the possible genesis of personality and 
"style" factors in home background and early childhood . 



a. A large part of Study VII was devoted to these questions. 

The results of the analyses were summarized as follows s 

(1) Permissivciiess of mothers . . * was found to be 
u’" . :1a ted to the de-velopment of general speaking 
a. Lity in older children. But permissive mothers 
were found to have children who achieve higher scores 
in language maturity. The results further suggested 
that boys who achieve higher speald.ng scores have 
been exposed to warm, indulgent and permissive types 
of child-rearing practices, whereas girls with better 
speaking skills were found to come from homes which 
were cold and strict. 



o 
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(2) Parental demands were not found to be strongly related 
either to general speaking ability as evaluated by 
speech specialists or to language maturii^o However, 
a marked relationship was discovered between parental 
demands and general speaking ability as assessed by 
teachers V The best single demand predictor of each 
criterion measure was Expectations in Education for 
the Child by the Mother. 

( 3 ) Generally, greater use of techniques of speech training 
in the home was associated with higher scores on gen- • 
eral speaking ability as rated by both the speech spe- 
cialists and the teachers > Use of speech training 
techniques did not seem to be related to Language 
Maturity as measured in the speech examination. 

4. Findings concerning the relative effectiveness of certain methods 
of teaching skills in written composition . 

This problem was investigated in Study VI, which used three methods of 
teaching in a 12-week experiment conducted in high schools; a "verbal 
fluency" method which emphasized methods of developing ideas for written 
compositions and which required large amounts of written composition 
exercise; a "structural grammar" method that emphasized the teaching of 
functional linguistic patterns, structural groups, and form classes; and a 
"logical structure" method that emphasized training in reasoning and the 
organization of thought. In a series of control classes taught by the same 
teachers, more conventional methods of teaching were usedo Covariance 
analyses determined the effect of each of these methods on a series of 
factor scores on verbal ability tests, including measures of excellence in 
theme writing. There were distinctive and significant gains made by cer- 
tain classes in each of the six factor areas- These significant improve- 
ments were partly due to transfer and not wholly due to direct learning, 
for the test battery included some verbal tasks which were not practiced 
upon even in the experimental classes. Each of the methods of teaching, 
including the control group, improved certain areas of verbal ability. 

However, only the Verbal Fluency method was found, in one class, to 
produce superior gains in the writing of themes. It had also been hypoth- 
esized that the Verbal Fluency method would improve abilities on various 
fluency factors, and this hypothesis was largely confirmed when it was 
found that the factor scores on Word Fluency and Fluency of Expression 
were improved by this specific training. However, Ideational Fluency and 
Verbal Relations scores were not improved even though specific training 
techniques designed to effect such improvement were emplc^ed in the exper- 
imental class- 

It had been hypothesized also that the Structural Grammar method 
would improve the abilities underlying the Verbal Relations factor and 
perhaps also the Reasoning factor. This hypothesis was borne out, for 
both of these abilities showed significant gains in some of the experi- 
mental classes- In addition, it was found that in one class Ideational 
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Fluency and Fluency of Expression were also improved even though the 
teaching had not been directed to develop fluency- 

A third hypothesis predicted that the abilities underlying the two 
Heasonin^ ^factors would be improved by the Xiogical Structure method* 

This hypothesis was borne out in one class which improved in general 
Reasoning ability. In addition it was found that the three fluency abil- 
ities had also been improved significantly in some of the experimental 
classes o 

In general, the stu^ demonstrated that abilities underlying various 
verbal factors are amenable to improvement through special training. 

Conclusions and Recommendations 



Although it is easy enough to identify and establish stylistic 
factors in spoken and written productions, it is very difficult to find 
relations between such stylistic factors and personality variables. The 
findings of this st\jdy in this regard were almost wholly negative. The 
failure to find significant relations in this study should not be inter- 
preted, however, to mean that no such relations exist-. Actually, the 
present study barety scratched the surface in its explorations « It 
revealed many aspects of verbal style and ability but did very little to 
relate them to personality variables. The field of speech and person- 
ality is still a fertile field for research = 

The present project also made a start towards identifying some of 
the home background and early childhood influences that might be 
responsible for the development of speech abilities and styles o How- 
ever, in this area also much research remains to be done- 

Finally, the present project contained one illustrat.’,ve study of 
methods of teaching communication skills- It showed that certain teach- 
ing methods were able to yield significant gains on certain verbal abil- 
ity tests. It is believed that useful research could be done by extend- 
ing the findings of the present study to include personality variables as 
moderator variables- 
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INTRODUCTION 



All societies, and particularly our conteii 5 )orary civilization, 
depend on connnunication and hence upon individuals -who are facile and 
effective in communicating information, ideas, opinions, and even literary 
insights. Communication sMlls are particularly important to a large 
class of ’’professional communicators”— teachers, journalists, clergymen, 
lawyers, radio announcers, ^rriters, scientists, public executives, legis- 
lators, and many others, but it is the hope of the schools to develop 
communication sluUs in all students to the extent of their abilities. 

It is for these reasons that we see the enormous emphasis put upon the 
teaching of English composition in the schools- Even though there may be 
less formalized emphasis on the development of oral speech skills, the 
schooDs nevertheless concern themselves also with the oral speech per- 
formance of students in classroom discussions and reports and in a host 
of extracurricular activities such as dramatics and debating. 

The student's intellectual ability, or lack of it, plays a large 
ro3.e in determining the limit to which his communication skills can be 
developed. If he has nothing of interest to say, or does not have the 
intelligence to learn how to say it, the schools cannot help him much in 
this respect— at least, this is the usual assun^tion. 

It was the basic hypothesis of this study, however, that another 
major factor that plays a role in the development of communication skills 
is the student's personality . Even an able student who has something to 
say will often not say it well, or not say it at aJl, because of what we 
call ’'personality.” He may' suffer from feelings of inferiority, he may 
have unfortunate attitudes about the need for communication, he may have 
unliealthy desires to dominate, his communications may be chiefly a reflec- 
tion of a fantasy life— these are among the possibilities. 

A further hypothesis of this study was that the schools can do a 
better job of teaching communication skills by taking account of the stu- 
dent's personality, and that this can be done by teachers, preferably in 
conjunction with guidance counselors in certain cases. 

The basic problems of the study, therefore, were (l) to investigate 
relations between personality and communication skills, (2) to experiment 
with ways of using such relationships in the teaching of communications 
skills, and (5) to develop practical materials and tools for the use of 
teachers and other school staff members « 

Among specific problems that were to be investigated were: 

(1) Nhat role is played by communication variables in determining 
the jud^ents of personality made by others? Do these judgments show any 
more than a chance relation to the "true,” underlying traits of personal- 
ity of the person whose communications are being judged? 
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(2) In what ways can conmruni cations products be described and mea- 
sured in relation to personality variables? 

(5) What personality variables are relevant to communications 
skilJLs? 

(^) Are there any influences in the child's early history which 
should be taken account of in guiding later development of comimmications 
skills? 

Since so much research has already been devoted to reading and lis- 
tening, and since reading and listening are "passive" skills in which 
personality variables are not likely to be of much importance, it was 
felt that the chief emphasis of the research should be on speaking and 
writing skills. 

Insofar as teachers are communicators, it was hoped that the studies 
might have a bearing on the training of teachers and the assessment of 
teacher competence- 

Specific Hypotheses 

lo The manner in which an individual communicates, whether in 
speech or "^-rriting, is a function of certain personality traits. This is 
also true of the content of his communication and of the circumstances 
under which he chooses to communicate* 

2. The manner in which an individual communicates, the content of 
his communication, and the circumstances under which he chooses to com- 
municate are all influential in forming others' judgments of him and his 
personalily and in causing others to accept, to doubt, or to reject his 
communications • 

The manner in which an individual communicates, as well as other 
aspects of communication, can be scientifically described and in some 
cases measuredo 

An individual can be taught to communicate in a manner which 
will make him more acceptable to others or make him have a greater influ- 
ence on others than he might otheiwise have. He can also be taught to 
communicate with others in such a way that he will be more articulate and 
effective in transmitting ideas. 

5* The means which should be enployed in teaching the individual to 
acquire desirable communication skills will depend in part on the partic- 
ular personality makeup of the individual, and this personality makeup 
can be readily determined by means of relatively simple tests or observa- 
tions o 



6. Among the personality variables which may be of particular 
relevance to the development of communications skills are; 
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a. Need for achievement (McClelland) 

Need for cognition; intolerance of ambiguity 
c. Perceptual rigidity (Luchins) 
d« Authoritarianism 

eo "Surgency” or flow of ideas (CattelD.) 

Dominance -submiss ion 

g. Introversion-extraversion 

h. Commonality of association (j. J. Jenkins) 

7 » Among the means that might be usefully employed in teaching the 
acquisition of desirable communication skills are the following; 

a« Varying the content required to be communicated 
b» Varying the social structure of the group within which 
communication is to take place 

c. Varying the audience of the communication and the manner 
in which the audience responds 

d. Varying the amount and kind of reward given to the 
communication 

Co Presenting models of speech and writing and encouraging 
imitative behavior 

fo Varying the units and amount of communication behavior 
which are to be rewarded 

Substudies in the Pro.ject 

Originally, the pro.ject /as conceived as a rather large-scale 
program that would involve a number of separate but related substudies. 

It was to investigate the problems set forth above by a many-pronged 
attack, working with a number of different samples of individuals at dif- 
ferent grade-levels. Certain detailed plans for these studies were drawn 
up, but as the program progressed it became evident that funds woiild not 
be adequate for carrying out all of them. Efforts were therefore con- 
centrated upon certain major studies that were regarded as of prior 
importance with respect to certain other studies that might or might not 
be completed depending upon circumstances. Towards the end of the offi- 
cial contract period, a listing of the studies actually accomplished and 
of the studies then under way was made. The present report constitutes, 
in effect, a memorandum on the status of each of these substudies as of 
the present time, i.ew, as of May I968. For convenience, the listing 
of the studies is presented here with brief remarks as to the relation 
of each study to the overall plan. 

Study I . Factor Analysis of Speech Performance Variables as Measured in 
Sixth-Grade Children 



This study was intended to identify the major dimensions of individ- 
ual differences in speech performance in a sample of sixth-grade children, 
as representative of children who would presumably be amenable to educa- 
tional procedures, designed to improve such performance, that might result 
from other substudies in the present project. (See pages I5-I7. ) 
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Study II • Changes in Perceived Personality Traits as a Function of 
Manipulations of Vocal Characteristics 

With its interest in possible personality correlates of vocal char- 
acteristics, the project here turned its attention to the dimensions of 
personality ratings that might be made from vocal characteristics, and to 
ways in which certain vocal manipulations might influence such ratings - 
(See pp. 17 - 20 . ) 

Study III. A Factor Analysis of Literary Style 

If "personality” exhibits itself in verbal productions, it might be 
expected to do so most strongly in literary productions. This study- 
sought to identify major dimensions of "literary s-tyle” that might later be 
^ownto be related to personali-ty. (See pp. 20-25.) 

S-budy IV« Opposite-Griving in Free Association Tests as a Personali-ty 
Variable 

The free association test has been a classic method of tapping cer- ; 
tain personali-ty dimensions. This study was focussed on the possibili-ty 
that a particular mode of responding to free associations might be a 
valuable indicator of personality. (See pp. 24-26. ) 

Study V. Relationships between Oral and Written Spontaneous Compositions • 

This study was to have been an investigation of -the possibility that 
style factors in verbal productions would manifest themselves in both 
oral and written spontaneous compositions. (See p. 26.) 

S-budy VI . A Comparison of Three Approaches to the Training of Written 
Composition Behavior 

One aim of the project as a whole was to develop instruments and 
procedures that wo-uld improve s-budents' communicative abilities in desired 
ways. Study VI was conceived in "bhis spirit, but undertook to look at 
problems of training in -written composition from a more general point of 
view, by comparing three possible approaches to such training: (l) in-bro- 

ducing a pressure towards ”q.uanti-ty” of verbal production by a "verbal 
fluency" method; (2) the teaching of "structural grammar," and (5) the 
teaching of logic and the organization of thought. It was tho-ught that 
students' personalities might interact with the success of these methods, 
partic-ulai’ly because of the possible relation be-bween "fluency" (which 
can be thOToght of as a dimension of personality) and method (l). (Actually, 
the possibility of such an interaction was not investigatedo ) (See pp. 27-54. 

Study VII. A Study of Home Background Variables Affecting Communicative 
Skills 



This was a study of variables from home background and early child 
hood that might explain variance in the factors of speech coimnunication 
skills identified in Study I. (See pp. 54-58. ) 
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Study VIII. Factor Analysis of Verbal Ability Variables in Relation to 
Written Communication S3d.lls 

This was the factor -analytic phase of Study VI, endeavoring to 
isolate dimensions of verbal ability. (See p. 58 . ) 

Study IX . Factor Analysis of Speech and Personality Variables Measured 
in Study VII 



This was to have been a factor -analytic study of data collected in 
Study VII to clarify the nature of the relationships found there. (See 
P* 39* ) 

Study X. Relations between Personality and Written Composition Style 

Having identified in Study III a nutnber of dimensions of "literary 
style" in literary productions, the investigators desired to ascertain 
whether these dimensions could be identified in high school students' 
themes and if so whether they would show any relations to scores on 
personalily tests. (See ppo 39”53*) 

Study XI. Study of Judgments of Children's Personality from Voice 
Recordings 



Study II had shown that voice and speech characteristics give cer- 
tain impressions of personality variables. This study, never accomplished, 
would have carried this investigation farther by using larger samples of 
children and using actual ratings of personality. (See p. -55*) 

Study XII . Studies of Speech Characteristics of Adults 

This study, never accomplished, would presumably have extended the 
findings of Study XI to samples of adults. (See p. '53«) 

Study XIII. (Because of an error of numbering in project memoranda, 
there was no such stu^« ) 

Study XIV. Review of the Literature of Speech and Personality 

BecaTise at the time that the project was undertaken there was not 
available any comprehensive review of the literature of speech and per- 
sonality since that by F H. Sanford (19^2), it was planned to write 
such a review for publication. (See p* 5^*) 

Study XV. Verbal Style of Conceptualization and Personality Characteristics 

This was a further attempt to identify styles in written verbal pro- 
duction and to relate them to personalily variables ? In this study, how- 
ever, attention was directed to styles of "conceptualization," i.e-, styles 
of perceiving and orga,nizing experience. (See p. 5^*) 
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The body of this report is divided into sections describing each of 
the studies that were completed or partially conqpleted as of termination 
of active work on the project- A considerable amount of active work on 
the project was done as a contribution of Harvard University even after 
official termination of the contract period, that is» after June 30> 
i960. Most of this additional work was done in the academic years I960- 

1962. 
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study I 

Factor Analysis of Speech Performance Variables 
as Measured in Sixth-Grade Children 



Introduction . At the outset of this study, little was known about 
the dimensions of communication skills, particularly those involving 
speech perf onnance « If one were to relate personality variables to 
communication skills, it would be necessary to have information as to 
the dimensions in which speaking performance skills vary- Early in the 
pro;ject period, the staff became aware of a study being conducted by Dr. 
Calvin Taylor of the University of Utah under Air Force Contract 
AF 18(600 )- 1211 , "Identification of communications skills in military 
situations." This was an extensive project that involved the giving of 
three large batteries of tests of written and spoken communications 
skills to several groups of Airmen and university students, with corre- 
lational and factor-analytic analyses of the data. It was hoped that^ 
this study would yield considerable information that would be useful in 
our study, but Dr. Taylor had not completed all his analyses, partly 
because of termination of the study. Of special interest would be the 
factor analysis of Dr. Taylor's Battery C, a group of experimental pre- 
dictor tests and situational tasks. Dr. Taylor supplied to this project 
the correlation matrix and the unrotated factor analysis matrix. Because 
of his interest in methods of oblique factor rotation, the Principal 
Investigator of this project undertook to perform the rotation of the 
factors of this matrix to simple structure. Unfortunately, either be- 
cause of the lack of "cleanness" of the factor structure or because of 
difficulties with the mathematics of the computations, a satisfactory 
rotation was never achieved, and this particular venture was put on the 
shelf until further insight was attained into methods of oblique factor 
rotation. The data are still awaiting further treatment. Dr. Taylor 
was able to submit only a very brief report of his investigation 
(Taylor et al., I958) and to my knowledge he has never published the 
full results of this investigation. It would sti 3 JL be useful to analyze 
and publish the factor analysis of his Battery C. 

Because the Taylor study was so well designed and promised to yield 
important information on the dimensions of communications skills in young 
adults, the staff of the present project decided not to undertake a com- 
parable study, but decided instead to investigate communication skills 
at a younger age level, namely, the sixth grade. It was thought that 
this would be the earliest point at which communication skills would have 
sufficiently matured to make a general survey possible; at the same time, 
this grade level was not so far advanced that it would be impossible to 
trace the early history of the children in order to investigate early 
childhood variables in the development of communications skills. 

The study that was actually done constituted one part of the doc- 
toral dissertation completed by Michael Marge-, Home background influences 







on the development of oral coima'unication skills in children> 

University Graduate School of Education, 1959'* It has been published by 
Marge, "A factor analysis of oral communication skills in older children. 
Journal of Speech and Hearing Research , 1964, 7 (l), 51-46. We give here 
a brief summary of the method and principal findings. 



Method 

Sample . This study utilized a group of children who had been 
studied three years earlier (when they were in the third grade ) by ^ ^ 
Carroll and Austin (1957) in an investigation of underachievement in 
reading. Of the 156 children (86 boys and 70 girls) studied earlier, 145 
(80 boys, 65 girls) remained accessible to the investigator. They were 
all of the Caucasian race, and were distributed among I 6 schoolU in 57 
classes in a m3.ddle -class suburban town (Newton, Massachusetts). However, 
Carroll and Austin had chosen not exactly a random sample but one that ^ 
would represent the several socioeconomic classes more equaliy. In Marge s 
study, 58 children were High SES, 51 Mid SES, and 34 Low SES. In Carroll 
and Austin's sampling design, provision had been mde to select approxi:- 
mately one-third "high over achievers," one -third average achievers, and 
one-third "lovr underachievers" in reading progress vrith respect to predic- 
tions from mental ages. Tnis distribution was preserved in the Marge 
study. 

Instruments and measurements . Forty different variables having to 
do wi-hh nv fli o.mrnmmication skills were derived from ttoee sources: 18 

variables from a Teacher Rating Form on which each child' s principal 
classroom teacher was to rate him on such scales as Voice Quality, Flow 
of Words, Articulation in Ordinary Conversation, etc. ; 5 variables from 
a Speech Skills Battery consisting of measures of articulation abil:.ty; 
and 17 variables from speech specialists' ratings of the child s speech 
performance in an interview situation. Scores on these 40 variables for 
the 145 children were factor-analyzed by the principal axis method with 
unities in the diagonal; the factor matrix was rotated to oblique simple 
structure by Carroll's (I962) "oblimin" method ("biquartimin criterion). 

Findings 

Seven interpretable rotated factors were isolated, as follo’^xs: 

^ I. General Spedking Ability as Assessed b- Speech Specialists 

II, Motor Skill in Speaking (defined only oy measures of speed of 
articul^-tion) 

UI, Speech Dominance ("Monopolizing, dominating behavior in oral 
communication situations, principally as rated by teachers) 

IV. Non-Distracting Speech Behavior (defined by "variables describ- 
ing verbal characteristics of speakers which do not draw attention to how 
the communication is presented"). This is a factor showing up in the rat- 
ings from both the teachers and the speech specialists. 
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V« Voice Quality^ measured by both teachers’ and speech speciaX- 
ists’ ratings of "appeal of voice" and "voice quality." It also inheres 
in ratings of correctness of pronunciation and fluency. 



VI. Language Maturity, measured by variables derived only from 
ratings of speech recorded in an individual interview. Grammatical usage, 
pronunciation, complexity of sentence structure, and vocabulary have the 
highest loadings on this factor- 



VII. General Speaking Ability as Assessed by Teachers; ’’At least ^ 
three in5)ortant aspects of the oral communicative process are included in 
this factor. The mechanics of oral expression are represented by j^o- 
nunciation, gramma tical usage, flow of words , and articulation; the con- 
tent aspect of speech is found in vocabulary 5 clarity of thought, co^un- 
ication of ideas, and wealth of ideas ; and the skill techniques are 
indicated by ability to give impromptu talks, general .b ehavior in oral 
re ading, ability in ueer-groun communications, and ability t o persuade 
classmates. 



These factors were in general independent; the highest factor cor- 
relation was .50, between factor I and factor VII, indicating that there 
was some small degree of agreement betr-reen teachers and speech specialists 
in assessing general speaking ability- On the other hand, it was a sur- 
prise that this correlation was so lowo It may be that factor I was 
.largely independent of factor VII because its variables were derived from 
performance in a highly specific situation in which the child was inter- 
viewed and tested by a relatively unfamiliar examiner. 



Discussion and Conclusions 

It was striking that speech performance in sixth graders was so 
conqplex and multidimensional. It was apparent that a complete assessment 
of speech performance in sixth-graders would have to take account not 
only of "general speaking ability" both in the classroom and in special 
interview situations, but also of such variables as "Speech Dominance, ^ 
"Non-Distracting Speech Behavior," "Voice Quality," and ’Language Maturity- 

Some of these variables or, rather, factor scores based on the results 
of this study, were used in a further study which constituted the second 
part of Marge’s doctoral dissertation. In the present report, this is con- 
sidered as Study VII. (See pp. 5^-38. ) 



Study II 

Changes in Perceived Personality Traits as a Function 
of Manipulations of Vocal Characteristics 



Introduction. One of the purposes of this program of research (see 
introduction to the study as a whole, page 9 ) was to determine the role 
played by communication variables in determining judgments oi an 
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individual’s personality made by others, and to find out whether these 
judgments would show any significant relation to true, underlying traits 
of personality* As a first step in exploring these problems, it was 
thought that studies should be made of the extent to which judges could 
agree ir. rating personality traits from voices, and of the extent to 
which such ratings could be affected by certain manipulations of vocal 
characteristics.. There is a vast literature on the ability of raters 
(usually untrained) to judge personality traits or physical attributes 
from voices, but in general, while these ratings are highly reliable in 
the sense that judges tend to agree strongly, they are invalid in predict- 
ing personality traits measured in more conventional ways (e.g., throu^ 
standardized personality inventories)* There has been little study of 
what actual characteristics of voices give rise to the ratings* By study- 
ing the effect of certain manipulations of vocal characteristics it was 
thought that some leads could be found toward identifying the elements 
that give rise to stereotypal personality-voice judgments* 

This study was conducted by Paul Kjeldergaardj the full report of 
the study is included here as Appendix A since it has heretofore been 
unpublished. We give at this point a brief summary of the methods and 
findings, together with certain comments concerning suggested further 
studies.. 

Method 

Recordings* The stimulus materials for ratings consisted of Ih 
readings of a single 307 -word passage which had been found to have rela- 
tively neutral ratings on six factors of literary style (cf* Study III)* 

[To supplement the information in the report reproduced as Appendix A, 
it may be said here that the passage was taken from the ^TOi tings of 
Matthew Arnold, an essay on the ’'function of criticism," in J* H* Smith 
and E* W. Parks, The Great Critics (3rd edition). New Yorks Norton, 1951> 
p. 612, beginning" "The critical porvrer is of lower rank than the creative * * . 
and ending • * no manifestation of the creative power not working 
with these can be very iiaportant or fruitful*"] This ’bland passage was 
selected in the hope that the content of the passage would not interact 
with voice-personality ratings or manipulations* (The design of the 
study did not, however, provide for any investigation of such interactions, 
since onOy a single passage was used. ) The ik readings were selected from 
a larger number obtained from 21 male Harvard undergraduates^ who were 
asked to read the passage under four sets of instructions: "normal, 

"fast," "shouting," and "soft.." Twelve of the readings were from three 
speakers who appeared to exhibit greatest contrast in voice quality among 
the four conditions; the two other readings were from two other speakers 
reading under the "normal" condition* All readings were elec cronically 
adjusted to approximately equal intensity when tape-recorded for presenta- 
tion. 

Measurements* ratings were to be accomplished on a semantic differ- 
ential form with I7 scales selected as appearing to describe personality 
traits and as appropriate for use by high school student raters* 
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S»nrpie of rater s .-» The 1^ recordings were played over a school 
public addr 5 r:ss system to classes in a senior high school in a middle- 
class suburban town in Massachusetts (Lynnfield). As soon as each 
reading had been played, each of the 557 students (in 15 classes, 
grades 10-12, assigned randomly to different orders of voices and 
scales) assigned ratings on l8 seven-point semantic differential rat- 
ing scales- (Data from only IT scales, i.e., excluding the scale 
likeable -unlikeable , were used in the analysis. ) 

Design - A split-unit design (Cochran 8s Cox, 1959) was used for 
the analysis of data from each of the 17 scales. This permitted test- 
ing of the significance of the differences among the 1^ recorded speech 
sanqples and of interactions between the speech samples and the classes o 
Means and standard deviations of the ratings assigned to each of the 
1^ speech samples were also examined for trends « 

Findings 

There were highly significant differences (£ < . 001 ) among the 1 ^ 
speech sanples on each of the 17 semantic-differential scales, indicat- 
ing that the raters agreed strongly on the ^judged characteristics of 
the speech samples. By examination of the means for voices recorded 
under different instructions, it was apparent that voices taken under 
the "normal** and **fast** conditions tended to be rated similarly and 
also that the **shout** and **soft** voices had similar patterns of ratings; 
further, that the **normal** and **fast** ratings tended to follow a pattern 
that is the mirror image of the ** shout** and **soft** ratings- 

On the average, the **normal** voices tended to be rated as excitable , 
emotional, insecure, undependable , outgoing, hunible, and careful . Never- 
theless, there were considerable differences among the five ^*nonnal** 
voices- The **fast** condition seemed merely to accentuate the ratings 
made on the **normal** condition so that the ratings of the **fast'* condi- 
tion on the above traits are slightly more extreme on all but two traits, 
insecure and emotional . (The results on these two last traits are, 
indeed, coui-ter-intuitive. ) The **shouting** and **soft** speech samples, on 
the other hand, were characterized on the average as careless, messy, 
intolerant, cruel, calm, patient, sympathetic, and emotional- . On four 
scales, leader-follower , dependent-independent , secure -insecure , and 
emotional-unemotional , the differences among conditions were small and 
generally inconsistent. Only the leader-follower scale produced differ- 
ences that were consistent from voice to voice and in the same pattern as 
on the scales previously discussed. 

Discussion and Conclusions 



This studj*’ effectively demonstrates that people, when asked to do so, 
make judgments about personality traits from the characteristics of voices. 
(**Voice'* actually inplies, here, not only vocal quality but manner of 
rendering a communication in an oral reading situation. ) These j'adgments 
appear to be highly consistent from rater to rater, at least for all the 
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traits measured here. Further, these judgments can be systematically 
shifted in one direction or another by changing the instructions under 
which the voice samples are rendered” What remains to be accomplished 
is the isolation of the specific variables in the speech samples that 
would account for the shifts in the perceived personality characteristics. 

An attempted analysis of differences between manipulations by means 
of a sound spectrograph proved fruitless. No further efforts in the^ 
direction of isolating such variables were made because of lack of time, 
funds, and personnel. Nevertheless, it would appear that various lin- 
guistic and other techniques of speech analysis might reveal consistent 
differences that would account for the judgments. 



Study III 

A Factor Analysis of Literary Style 



Introduction 



If "personality" exhibits itself in verbal productions, it might be 
expected to do so most strongly in literary productions. It was there- 
fore decided early in the program of research to attempt to find measur- 
able objective dimensions of literary style. If such dimensions could be 
found in literary productions of professional writers, the results might 
also be applied to the compositions of, say, high school youngsters. 

Study III was therefore designed in two parts: IIIA, a study of dimen- 

sions of style in passages selected from a variety of literary sources, 
and IIIB, a study of personality dimensions ratable from samples of high 
school English con 5 )Ositions, with an attenqpt to link these ratings with 
external measures of personality. 

During the contract period, only Study IIIA was completed, and even 
then, only a limited summary of the results found its way into print: 

Carroll, John B. Vectors of prose style. In Thomas A. Sebeok (Ed. ), 

Style in language . New York: Wiley (in cooperation with the Tech- 
nology Press of the Massachusetts Institute of Technology), 19b0. 

283-292. 

However, two internal documents relating to this study should be cited: 

Carroll, John B. A sub-sub-treasury of literary style; I 50 300-word 
passages from a variety of authors and sources. January 195®« 
(Dittoed) 

Carroll, John B. A factor analysis of literary style. April 1958. 

(Mimeographed, hi pp. ) This was a preliminary report and contains 
a considerable body of statistical data, including correlation 
matrices. However, the factor rotation was considered unsatisfactory; 
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technical improvements in rotation methods later produced the rotated 
factor matrix that was presented in the published article above* A 
copy of this paper is included as Appendix B of this report* 

It remains to complete a full report of this study* Such a report 
would include not only the statistical data but a full account of how 
each of the numerous objective variables was coded-. Data on the extent 
to which raters agreed with the consensus of raters or were idiosyncratic 
in their ratings should also be analyzed and written up* 

Study IIIB, the extension of Study IIIA to samples of high-school 
students' compositions, was renumbered Study X, discussed later in this 
report (see pp* 59"55)* 

¥e give here a brief summary of Study IIIA and its findings. 

Method 



Sample* 150 passages of at least 500 words each were assembled from 
a wide variety of sources according to a design which called for a certain 
number of passages from each of such categories as Adventure Narrative, 
Advertisements, Aesthetic Criticism (Art, Music, Literary, etc* ), Anecdote, 
Biography, » * ^ Travel Guides, and Writing Assignments (hi^ school). 
Restrictions were: originally written in English, written after the year 

1800, and self-contained in 500 words* These passages were typed, one to 
a page, duplicated, and bound in a collected work entitled "A sub-sub- 
treasury of literary style*” 

Measures o There were 29 subjective meas\ires, consisting of the mean 
ratings (averaged over eight Judges) on semantic-differential scales 
especially chosen to tap various aspects of style* There were 59 objective 
measures of style, including such measures as number of paragraphs, number 
of syllables, number of sentences, standard deviation of sentence length, 
number of clauses, clause complexity index, proportion of noun clauses to 
a ll dependent clauses, and so on* Nearly all the measures had reference to 
one or another grammatical category or phenomenon. Scores of the passages 
on the objective measures were obtained by specially trained coders* 

Method of analysis* ‘i'Jherever feasible, reliability estimates were 
obtained for the measures— by the intraclass correlation method for the 
raters' Judgments, in the case of the subjective measures, and by the 
split-half method, in the case of the objective measures* Before com-^ 
puting intercorrelations, many of the measures were subjected to logarith- 
mic cr arc-sine transformations* The correlation matrix was factor- 
anajyzed by the centroid method (with communality estimates in the 
diagonal of the matrix). Seven factors were rotated by the author's 
oblique biquartimin method* Factor scores were obtained for each of the 
factors, and "profiles" for each passage on the seven factors were plotted® 

Findings 




Reliability coefficients for the 29 averaged subjective ratings 
ranged from *6^ for the scale w eak- s tr ong to *92 for the scale humorous- 



-22 



serious, with a median at .8o. Among the 59 objective measures, only 51 
cavjjTbe assigned reliabilities; these ranged from .17 for standard 
deviation of sentence length to .88 for mean tense, with a median at .5o* 

Six interpretable factors emerged from the factor analysis: 

I GOOD-BAD! defined almost solely by subjective scales such as 
good-bad, vie as ant-unpleas ant , strong-weak , 
interesting-boring, etc - 

II EERSONAL-IMEERSONAL: measured by subjective scales such as 

personal-iTmaersonal, intimate -r emote , emotional- 
rational, and vigorous -placid , and also by objective 
measures such as number of personal pronouns , number 
of pronouns, and (negatively) number of syllable S o 

III ORNAMENTEID-PLAIN : measured by subjective scales florid-plain, 

wordy-succinct, lush-austere , affected-natiiral , and 
c omplex— s imple as well as objective variables such 
as length of sentences, length of clauses, and ^o- 
portion of common nouns prec<5ded by adjectival or 
participial modifiers » 

IV ABSTEUlCT-CONCRETEs measured by subjective scales subtle - 

obvious, abs tract-concrete , profound-superficial, 
original- trite, and elegant-uncouth, and certain 
objective indicators such as a low proportion of 
numerical expressions , a low number of determining 
adjectives and pronouns like "this," "each," etc«, 
a high proportion of noun clauses, and a low number 
of participles o 

V SERIOUS-HUMOROUS s measuired by subjective scales earnest - 

flippant and se rious -humorous and by such objective 
indicators as a low proportion of indefinite arti- 
cles, a high proportion of indefinite and quantify- 
ing determining adjectives, and a high number of 
determiners (all associated with the serious end of 
the scale). 

VI CHAPACTERIZING-HARRATING: measured exclusively by objective 

indicators: a low proportion of transitive verbs, 

a high proportion of copulative verbs relative to 
all verbs, a low number of proper nouns, a high pro- 
portion of adjective clauses, and a high proportion 
of intransitive verbs o (This interpretation of the 
factor, incidentally, could be checked by correcting 
the factor scores with ratings of characterization vs. 
narration o ) 
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Discussion and Conclusions 



It cannot be claimed that this study tapped all possible dimensions 
of style. As was pointed out by Paul Diederich in a paper on factors in 
judgments of writing ability (Diederich, French, & Carlton, 19^1 ), other 
dimensions of style might have been obtained through the use of further 
subjective and objective measures. Nor can it be claimed that the dimen- 
sions identified here adequately represent the aspects of style that 
truly make the difference between great literature and mediocre litera- 
ture- Nevertheless, some of the hopes in which the study was undertaken 
seem to have been realized: the study points to some of the more obvious 

characteristics of prose that have to be observed, mentioned, and duly 
noted before the literary critic can really go to work. 

The "style" dimensions identified here also may conceivably have 
relationships to the personalities of writers. Although a really skill- 
ful writer might be able to vary his style along any one of the dimensions, 
a person whose written style exemplifies a consistent style profile could 
possibly be shown to have certain corresponding personality characteris- 
tics- For a preliminary study of this hypothesis, see Study X. 

The study also has a bearing on the measurement of readabili1y« 

Before his death. Professor Irving Lorge supplied the writer with Lorge 
Readability Ratings for each of the 150 passages in our Sub -Sub -Treasury 
of Literary Style- (The Readability Rating for passage ^8, a selection 
from a legal document that consisted of a single unfinished sentence, was 
unusable because it gave the meaningless grade equivalent of 23 . 65 .) The 
various elements of Lorge 's index, and the index itself, gave the follow- 
ing correlations with factor scores from the style study for 1^9 passages: 

FACTOR 





I 


II 


III 


IV 


V VI 




(Good- 


(Personal 


- (Or- 


(Absto - 


(Serious- (Characterizing- 


Lorge measures 


Bad) 


Impers- 


) nate ) 


Cone. ) 


Humorous ) Narration ) 


Av. Sentence 
Length 


-.091 


-.169 


•597 


.052 


.iko .169 


Ratio of Prep- 
Phrases 


.026 


-555 


.501 


-.100 


•259 .176 


Ratio of Hard 
Words 


.008 


-.it-Oi^ 


A87 


-.138 


-.002 .020 


Readability 

Index 


-013 


-595 


.71^ 


-.088 


.126 .218 


Evidently, 


the Lorge Readability Index is a 


composite indicator of 



the "ornamental" and "impersonal" aspects of style that make for difficulty 
in reading. These results were discussed further by Lorge in a presenta- 
tion at the i960 ETS Invitational Conference on Testing Problems (Lorge, 
I96I; also reprinted in Anastasi, I966, pp. 597 “606). It would be desir- 
able, however, to publish a full report of these findings. 



study IV 



Opposite -Giving in Free Association Tests 
as a Personality Variable 



Jenkins (i960) had suggested that commonality of responses to free- 
association tests might be an important indicator of personality, and had 
assembled certain limited data supporting this suggestion. In attending 
a conference at the University of Minnesota on Associative Processes in 
Verbal Behavior (Jenkins, 1959 however, the principal investigator was 
prompted to speculate that commonality as usually measured by the number 
of "primary*' responses a subject would give to a word-association test 
might be a complex variable, partly' dependent upon his tendency to give 
"opposites" or opposite-like responses to certain words that are hig' \y 
likely to evoke such responses. An examination of word-association norms 
(Russell & Jenkins, 195^) revealed that opposites are in all cases among 
the five most frequent responses to words that indeed have opposites; in 
28 out of 4 o words in the Kent-Rosanoff list opposites are the most fre- 
quent responses. It was thus hypothesized tha,t there might be consistent 
and reliable differences among Ss in their tendency to give opposites to 
opposite-evoking words, and that these differences would be relatively 
independent of the tendency to give "primary" responses to words which 
do not have opposites* If such consistent individual differences could 
be identified, it might be easier to relate them to personality variables. 

Although responding to free -association tests is not a typical com- 
munication skill, there has been a wealth of research demonstrating that 
free -association responses are indicators of mental processes important 
in verbal behavior and learning. 

The first task was to study opposite-giving behavior in free- 
association tests in order to confirm or disconfirm the h 3 npothesis of 
consistent individual differences in this behavior. This study (Study 
IV-A) was performed and reported on in the following article: 

Carroll, John B., Kjeldergaard, Paul M. , Ss Carton, Aaron S. Number of 

opposites versus number of primaries as a response measure in free- 

association tests. Journal of Verbal Learning and Verbal Behavior, 

1962, 1 (1), 22-50. 

Study IV-A had several phases. In Phase I, project staff members classi- 
fied words in the K-R (Kent-Rosanoff) list into three classes: (l) adjec- 

tives having opposites; (2) nouns or verbs having opposites; and (5) words 
not having opposites. Classes (l) and (2) were labeled opposite -evoking 
stimuli ( OES ). All words considered appropriate opposites to the stimuli 
were listed. The results were confirmed by giving a somewhat similar 
task to 42 sophomore women at Simmons College (Boston). From these data 
a scoring key for "opposites" was developed for use in later analyses. 

The results were used to perform analyses of the Russell- Jenkins free- 
association norms, supporting the conclusion that "commonality" is, in 
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large part, a function of the tendency on the part of the Ss to respond 
to a subset of stxmulus words (OES) with responses which may be behavior- 
ally defined as opposites.'* In Phase II, it was shown that in a further 
sample of free-association responses from k 6 Simmons College undergraduates, 
opposite-giving tendency was consistent (r = from the first half to 
the second half of the K-R list, while primary-response giving tendency to 
nonopposite -evoking stimuli showed a coefficient of only .46. The two 
types of scores correlated only to the extent of .26 (not significant for 
this sample). In Phase III, analyses were made of free-association 
responses to the first 50 words of the K-R list by 544 suburban (Lynnfield, 
Mass.) hi^-school students, and a follow-up with the same test on 211 of 
these students l6 months later- The test-retest correlation for the oppo- 
site responses was .65, for the primaries in response to nonopposite- 
evoking stimuli this coefficient was .56. It was also found that high 
opposite-givers tended to give different responses to the nonopposite- 
evoking stimuli from those given by persons who never gave opposites. For 
example, an "opposite -giver" will probably give moth as a response to 
butterfly while a "nonopposite -giver" will most likely give insect to the 
same stimulus . 

A second task was to explore the relations between opposite -giving 
tendencies and personality variables. '.Phis study (Study IV-B) was per- 
formed and reported on in the following article- 

Kjeldergaard, Paul M. , & Carroll, John B. Two measures of free associa- 
tion response and their relations to scores on selected personality 

and verbal ability tests- Psychological Reports. I965, ^ 667-670. 

In Study IV-B, 231 senior high school students (rather heterogeneous in 
ability and socioeconomic class status) were given two personality tests, 
the Minnesota Counseling Inventory and the Guilford-Zimmerman Temperaiaent 
Survey- These were the same students as had been used in the follow-up 
phase of Study IV-A, and they had, of course, been given the K-R test on 
both occasions. They had also been given, I6 months earlier, 27 verbal 
paper-and-pencil ability tests in connection with another study (Studjr vi) 
in this same program of research. The purpose was to correlate the 
association-test scores with both the personality inventory subscores and 
the verbal ability test scores. To quote from the report, "Product-moment 
correlations between the-'.e scores [the association- test scores] and the 
personality measures were consistently low; only six of the 72 rs (I8 per- 
sonality scales, two K-R scores, two sexes) reached significance at the 
.05 level- All these [significant] correlations were from the girls* matrix; 
the matrix for boys failed to yield any significant correlations. In both 
matrices, male and female, the magnitude and sign of the correlations for 
each of the K-R scores were similar. 

"A quite different correlational pattern emerges if one examines the 
interrelationships between the 26 verbal tests and the tvro K-R scores. 

Here the correlations with the opposite score are virtually a 1 1 very close 
to zero, whereas the correlations with the nonopposite primaries score 
range from 0.00 to +0-2 30, 22 of the 26 correlations being significant at 
the 0O5 level [the median r being .18] ... . None of the relationships 
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is of a sufficient magnitude to warrant excitement, but the presence of 
consistent differences in the two arrays of correlations strongly sup- 
ports the contention that the tendency to give or not to give opposites 
is a verbal habit different from the tendency to respond with primary 
responses to stimuli which do not evoke opposites. This conclusion is 
further supported by the low correlations between the two K-R scores : 
+•5^ (N = .90) for the boys, and +.56 (N = 15^) for the girls <?" 

Kjeldergaard further showed (KJeldergaard, I962) that commonality 
of scores of Ss instructed to give opposites were as high as commonality 
scores of Ss who were told to respond with the most popular responses^ 

This phase of the project may be regarded as completed^ It estab- 
lished (1) that there are reliable individual differences among Ss in 
the tendency to give opposite or opposite-like responses to free- 
association tests, (2) that this tendency has a relatively low correla- 
tion (about .55) with the tendency to give primary responses to nonoppo- 
site-evoking words; (5) that neither of these tendencies shows any sub- 
stantial relationship to scores on two personality inventories (the 
Guilford-Zimmerman Temperament Survey and the Minnesota Counseling 
Inventory); and (^) that opposite -giving tendency has hardly ar^ rela- 
tionship to any of several verbal ability factors, but that the tendency 
to give primaries to nonopposite-evoking words shows small but generally 
positive correlations with verbal ability tests (median r = »l8, range 
from --I5 to .30 in a set of 26 verbal ability tests). 



Study V 

Relationships between Oral and Written Spontaneous Compositions 



In the original project proposal. Study V was to be "an experi- 
mental study on the teaching of oral communication skills," but planning 
of such a study was delayed because of the preoccupation of the staff 
with other studies- In the third year of the project, it was realized 
that time and funds would not permit undertaking this stucty’, and there- 
fore it was dropped from the plans. 

As a substitute for this. Dr. Robert Gardner, a Researc -'ssociate 
on the project in its third year, proposed to make a study - ^-elation- 
ships between oral and written spontaneous compositions with respect to 
the style factors that had been identified in Study III. To this end, he 
made arrangements to have from 100 to I50 students at lyiinfield (Mass. ) 
High School given an oral picttire narration test in which the students 
were directed to study a picture for a few minutes and then to tell a 
story about it- The data were collected, but after examination of the 
transcribed stories it was decided that there was too little variation 
in them, with respect to literary style factors, to make ratings possible. 
This particular project, therefore, was dropped- (See Study X, however, 
for a somewhat similar project in which relations between ratings of 
^ written themes from the Lynnfield students and personality measures were 
investigated- ) 
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study VI 

A Comparison of Three Approaches to the Training 
of Written Composition Behavior 



Introduction 



In the original project proposal. Study VI was planned as ”an 
experimental study of the elicitation and training of written composi- 
tion behavior, and it was suggested that a more natural slyle of 
writing might be obtained if studeuts were asked to write under con- 
siderable pressure and with lowered standards of quali'ty. After study 
of the literature on the teaching of writing ability, this plan seemed 
less attractive than it had been originally. A doctoral candidate, 
Frederic D. Weinfeld, took over responsibility for the project, and 
after considerable discussion with other staff members decided to mod- 
ify the plan by the addition cf two other treatments besides (l) quan- 
tity production, namely, (2) teaching of "structural grajnmar," and 
(5) the teaching of logic and organization of thought. Further, treat- 
ment (l) was altered to emphasize the teaching of various techniques 
for getting fluency" in writing* Extensive pretesting and posttesting 
of students in various verbal abilities as well as theme-writing ability 
was to be done in order to study what transfer effects of the various 
treatments could be observed* 



This turned out to be a major enterprise because of the extensive 
testing that was done and the (12-week) duration of the experimental 
treatments. Experimental and control classes were set up in both Concord 
and Lynnfield high schools. The work was done in the academic year 1958- 
59 > i»e., in the second year of the study, and Mr. Weinfeld was able to 
present his doctoral thesis in the spring of 1959, entitled, "A factor 
analytic approach to the measurement of differential effects of training: 
an evaluation of three methods of teaching English composition." It may 
Ij^'fcsrest to note that the test data collected in Lynnfield were 

used in several other studies conducted in this program of research, nota- 
bly Study IV. 

As far as the Principal Investigator is aware. Dr. Weinfeld has not 
published the results of this study in the standard literature. His 

thesis, however, is available from the Harvard Graduate School of Educa- 
tion library. 

To summarize this study, we shall quote from the Abstract included 
in the thesis. 

"^e teaching of English composition has been selected as the field 
to be investigated in this study primarily because so little empirical 
research has been done in this important area. Three experimental methods 
of teaching have been devised, based on many of the suggestions, findings 
and proposals made in the literature : the Verbal Fluency method, taught 

predominantly In the 9th grades- the Structural Grammar method, taught in 
the 10th grade; and the Logical Structure method, taught in the 11th grade. 
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"The Verbal Fluency method of teaching English composition followed 
from the strong belief that students learn writing only by writing and 
not by doing grammatical drills- The basic idea was to have the students 
write as much and as often as possible. Some writing was done every day. 
It was hoped that such quantity writing together with other verbal exer- 
cises would increase the writing ability and the verbal and ideational 
fluency of the student- The emphasis at first was on quantity production 
of writing; as the student developed ease and flow in his writing the 
queJ-itative aspects were stressed. In order to relieve the teacher from 
correcting the extra volume of written work which was produced, class 
correction of papers was attempted as well as cooperative correction of 
selected student papers. The latter technique served a double purpose. 

On one hand it supplied the student with related material for grammati- 
cal drill; on the other hand it served as a means for developing clari'bjr 
in writing and exactness in expression. The approach to the teaching of 
grammar in this method was a functional one. Only the more common maj’or 
errors made by the students were selected by the teacher for special or 
further elucidation in class- There was no formal teaching of grammatical 
principles, rules, usage, or sentence structure, as such. In the writing 
of papers and during the correction of papers eii 5 )hasis was placed upon 
saying what is meant. Exact expression of words and ideas, diction, 
clarity, and rhetoric were stressed. The student devoted himself to try- 
ing to develop a facility in finding the exact words to express his 
thoughts - 

"The class time in the Verbal Fluency method and in the other exper- 
imental methods was divided into four half -period sections. One half- 
hour, or half -period, was devoted to class exercises designed to stimu- 
late and develop verbal and ideational fluency. Word games, puzzles, 
training in synonyms and antonyms, word and idea listing, word exercises 
involving the use of the dictionary and of Roget^s Thesaurus, and similar 
exercises were carried on during this time. One half-hour was spent in 
writing in class. Another half-hour was spent in class correction of 
papers. The final half-hour was consumed by cooperative correction of 
selected student papers. Some writing, even if only a short paragraph, 
was expected of these students every day. 

"The Structural Grajnmar method emphasized the teaching of functional 
linguistic patterns, stinictural groups, and form classes. Formal gram- 
matical nomenclature and rules were replaced by structural and functional 
language patterns. It was hoped that the training in these structural 
principles of language would give the student a better and more funda- 
mental understanding of the English langus-ge and that he would be able to 
use this knowledge in his own writing. Tne teaching materials of the 
Structural Grammar method were presented by the teachers in a formal man- 
ner. In the writing of papers and during the period of cooperative cor- 
rection, emphasis was placed on grammatical patterns, good usage, and 
sentence structure. 

"The Structural Grammar teachers devoted one half -period to class 
instruction in the basic principles of language structure using Robert's 
Patterns of English (195^) as their text and guide. One half -period was 
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spent on class exercises and oral and written drill on the structural 
principles tau^t. A half -period of class writing was devoted to relat- 
ing the formal structural grammar instruction with the actual writing 
skills of the students. The final half -period was devoted bo cooperative 
correction of student papers. 

"The third method, the Logical Structure method, had as its under- 
lying precept the concept that good thinking \mderlies good writing. 
Training in reasoning and logic and in outlining and organization was 
considered to be beneficial to student writing. Direction and instruc- 
tion in reasoning, clear thinking, and organization would enable the 
more mature high school student to improve his written compositions. 

The approach to the teaching of grammar in this method was a functional 
one. Only the more common major errors made by the students in their 
papers were discussed. There was no formal teaching of grammatical 
principles as such. Clear thinking was stressed at all times and atten- 
tion was directed to the reasoning process and the meaning of words. 

The written work has checked primarily for its organization and for the 
thinking involved. Stress was placed upon explaining what was thought 
and the reasons which led to such conclusions. It was hoped that a 
careful and thoughtful approach to writing would greatly improve its 
q.ua3-i-ty? 



"The Logical Structure method devoted one half -period to class 
instruction in various aspects of clear and critical thinking, such as: 
formal logic, syllogisms, definitions, false analogies, scientific 
method, and inductive and deductive errors. One half -period was spent 
in class exercises, oral and written, in the above material. Tb/e next 
half -period was devoted to training in the development and use of outlines 
in theme writing. The final half-hour was spent on the structural ele- 
ments of a written composition. This included standard units in the topic 
sentence, paragraph organization, and theme unity. 

"The control groups consisted of those classes which were taught by 
the teacher’s own standard method of procedure. In these classes the 
individual teacher used any method of traditional teaching as long as it 
was distinctive from any of the experimental methods. 

"The teachers of each method met together once a week in a small 
workshop where they reported their progress and discussed techrlques, 
methods, and materials. The experimental teaching was conducted along 
the lines of action research. That is, ideas which in practice worked 
out poorly in the classroom were discarded. A successful idea developed 
by one teacher was communicated in the workshop to the other teachers. 
Successful ideas and methods used in one school system were passed along 
to the parallel workshop in the other school system. Each teacher 
received a directive outlining the general procedures to be followed. 
Mimeographed materials were prepared and distributed to the teachers. . . 
New materials were prepared whenever the teachers voiced such needs. 

Word games and exercises together with topics for themes were distributed 
to the Verbal Fluency teachers. Selections and exercises from the Roberts* 
text were mimeographed for class use in the Structural Grammar method. 
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Lesson plans for the teacher -were also prepared. The teachers of the 
Logical Structui'e method received a bibliography of pertinent books and 
articles as vrell as a guide to clear and critical thinking in lesson 
plan form. 

"Approximately two-fifths of the weekly class time (two periods) 
was set aside for experimental teaching. This is the class time in which 
the teacher normally would have taken up grammar and conqoosition. The 
training phase of the experiment was approximately ten weeks. 

"Two school systems. Concord and Lynnfield, Massachusetts, partici- 
pated in this study.. There were eleven cooperating teachers in the two 
schools, who were randomly assigned to their respective experimental 
methods. These teachers did not have any previous training or experi- 
ence with the experimental methods- They varied in ability, experience, 
and interest in the experimental methods. The subjects of the experiment 
were approximately 800 students, boys and girls, of the entire 9th, 10th, 
and nth grades in the Concord and Lynnfield High Schools. Most of the 
students took part in the pretesting and posttesting sessions, which took 
place in September and in February, respectively^ 

"The experiment was replicated by conducting it in a parallel fashion 
in the two schools at the same time. In each grade, in the two schools, 
one teacher was chosen as the teacher for the primary study. These 
teachers taught a control class and also one, or often two, of their 
classes by an experimental method,. In addition to the six teachers in 
the primary studjr there were two alternate teachers. The other three 
teachers participated in a secondary study which will be reported at a 
later datev 

"The selection of the test battery was determined on the whole by 
the fact that a factor analysis of the data was proposed. Since the study 
was concerned with English composition, the various known factors which 
might be involved in the ability to write a composition were selected as 
relevant to the investigation. The various fluency factors. Word Fluency, 
Ideational Fluency, Fluency of Expression, and Associational Fluency, 
were considered relevant to this study because of the type of training 
involved in the Verbal Fluency method. The Verbal factor was of course 
selected since this ability is very probably involved in writing ability 
and in all experimental methods including that of Structural Gi’ammar. 

Since the Logical Structure method involved training in reasoning and 
organization, it was assumed that the factors cf Inductive and Deductive 
Reasoning might be functioning in writing ability end so these two rea- 
soning factors were also selected. Twenty-three tests, which had been 
used in previous factor analyses and whose factorial composition was known, 
were chosen as measures of the seven selected factors. A theme, which was 
to be written by the students and rated on five sepai’ate scales, was also 
included in the test battery. 

"The paradigm of this study included the battery of pretests admin- 
istered to all the students of the two school systems, a ten-week period 
of classroom training using the three different methods of teaching English 
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conqposition, and the identical test battery administered over again as 
the posttests- The resulting test scores were correlated and then 
factored- Seven factors were extracted by the principal axis method 
of factor analysis. The first six factors were then rotated to psycho- 
logical significance by Carroll’s Oblirain analytic method. 

"An exceptionally clear factorial structure emerged after the 
rotation. Most of the tests were pure tests and had a major loading 
on only one factor. A few tests had minor loadings on a second factor, 
and only one test’ was complex, having minor loadings on three factors. 

"Factor A was identified as Theme Writing since all four theme 
ratings were loaded on this factor. Wo other tests had loadings on 
this factor? It is probably the same factor as the Writing Skill factor 
found by Harris (19^8), which was also defined by similar subjective 
ratings on a san^le student theme - 

"Factor B was very cleariy the Ideational Fluency factor® The six 
tests postulated to measure Ideational Fluency all had high loadings on 
this factor- In addition two tests postulated to measure Fluency of 
Expression had moderate loadings on this factor- Factor C appeared to 
be Thurstone's (1938) factor of Verbal Relations. In addition to the 
tests of the Verbal factor, the Words in Sentences test had a fairly 
high loading on this factor also- Factor D was without question the 
familiar Word Fluency factor. All tests of Word Fluency, including the 
reference tests, were loaded on this factor. Factor E was identified 
as the composite Reasoning factor. All the tests postulated to be mea- 
sures of both the Inductive and Deductive Reasoning factors were loaded 
on Factor E. 

"The sixth Factor F was the only factor which presented any diffi- 
culty in interpretation. There seemed to be two separate abilities 
involved in these tests. One was the speed of producing words fitting 
certain general restrictions, and the other ability was the production 
of specific words which are appropriate to a given concept- This factor 
mi^t be considered to be the Speed of Eduction of Appropriate Expression; 
however, it was considered that this factor was similar enough to the 
factor of Fluency of Expression found by other investigators to be identi- 
fied by that name- 

"The pretest factor scores for each individual student on the six 
factors were computed by Harman’s (Holzinger & Harman, 19^1) "Shortened" 
method using the pretest scores and the factor score coefficients derived 
from the factor matrix- Then the posttest factor scores for these stu- 
dents were also computed using the posttest scores and the same factor 
score coefficients- Both the pre- and posttest factor scores were com- 
puted on the bas’.s of the initial factor matrix so as to enable their 
later comparison- 

"The experimental and control classes were now compared on the basis 
of their standardized and transformed factor scores. For every pair of 
classes a separate two-^my analysis of variance with covariance adjustments 
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was performed for each factor. The posttest factor scores of the classes 
were adjusted on the basis of initial ability as shown by their pretest 
factor scores- The null hypothesis tested stated that there was no dif- 
ference between the posttest factor scores of the experimental class and 
those of the control class taught by the saiae teacher^ the classes being 
matched statistically on the basis of pretest factor scores. 



"The covariance analyses revealed that there were distinctive and 
significant gains made by certain classes in each of the six factor areas. 
These gains made by the students in the various verbal abilities were 
gains over and above the con^arison class taught by the same teacher. 
These significant improvements in the verbal abilities were partly due to 
transfer and not wholly due to direct learning, for the test battery 
included some verbal tasks which were not practiced upon even in the 
experimental classes. Gains on these tests, therefore, were partly 
caused by the transfer from learning activities in the classroom which 
had some underlying similarity to the test tasks. 



"The spread and amount of improvement effected varied according to 
the individual teacher and according to the method of training used. 

Each of the methods of teaching, including the control group, improved 
certain areas of verbal abilityo Certain teacher differences were 
evident as well as differences in classes of various levels of ability. 
Two teachefs, although using the same method, did not necessarily pro- 
duce the same results since their teaching and method of presentation of 
material was modified by their own ability, personality, interest, and 
previous manner of teaching. Nevertheless, it was found that each of 
the three experimental methods could be taught effectively by ordinary 
classroom teachers without any special training. 

"it was hypothesized that each of the three experimental methods 
would be superior to a conventional method of teaching English con^osi- 
tion in the writing of themes. Only the Verbal Fluency method was 
found, in one class, to produce superior results in the writing of 
themes. However, the lack of a significant difference between the 
classes does not suggest that the experimental groups did not gain; 
rather, it means that the gains of the two groups were approximately 
equal- 



"One hypothesis had stated that the Verbal Fluency method woTild 
inprove the abilities underlying all three fluency factors and even per- 
haps the Verbal Relations factor- Most parts of this hypothesis were 
borne out- The factor scores on Word Fluency and on Fluency of Expres- 
sion were improved by the specific training as expected. However, 
Ideational Fluency was not inqoroved by this method even though specific 
training techniques were employed in the experimental class, nor was 
the Verbal Relations ability inproved. Finally, the Writing ability, as 
measured by factor scores, was improved in one class taught by this method. 

"A second hypothesis predicted that the Structural Grammar method 
would inprove the abilities underlying the Verbal Relations factor and 
perhaps the Inductive Reasoning factor. This hypothesis was borne out. 
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Both of these abilities were improved in some of the experimental 
classes. In addition, it was found that in one class Ideational Fluency 
and Fluency of Expression were also improved even though the teaching 
had not been directed to develop fluency. 

”A third hypothesis predicted that the abilities underlying the two 
Reasoning factors would be improved by the Logical Structure method^ 

This hypothesis was borne out in one class which improved in general 
Reasoning ability. In addition it was found that the three fluency 
abilities had also been improved significantly in some of the experi- 
mental classes. Evidently the training in the Logical Stiructure method, 
which included training in words and their meanings and connotations, 
brought about this unexpected increase in the three fluency factors. 

“Apart from the superior improvement derived from the three exper- 
imental teaching methods, the control, or conventional method of teach- 
ing also produced superior improvement in certain areas in some classes. 
The control group as taught by one 9"^^^ grade teacher produced a superior 
improvement in Ideational Fluency and in Verbal Relations. A 10th grade 
control class improved in Theme Writing ability and another Non-College 
control class improved in Ideational Fluency and in Word Fluency. The 
control class of an 11th grade teacher improved in Reasoning and Fluency 
of Expression, as did the control class of a 9th grade alternate teacher. 
These control class gains were mostly in Concord and were generally 
sporadic. They do not represent any trend, but rather variatioi.s due to 
individual methods of instruction used by the teachers in their 'regular' 
methods of teaching. 

"Another stated purpose of this study was to determine whether the 
abilities underlying the factors are amenable to training. It was hy- 
pothesized that the abilities represented by the cognitive factors are 
capable of being improved by special training. This hypothesis was 
borne out completely. Every factor ability was found to have been 
improved by at least one of the three methods. That is, the factor 
scores increased significantly over the normal increase due to learning 
and maturation. It was demonstrated that when an ability had been 
improved, most of the tests highly loaded on the same factor had also 
increased. 

"Once improved, a factor ability is capable of improving performance 
on other tasks vzhich utilize this ability to some degree. lOiowledge of 
the teaching methods causing such an ir^rovement is therefore of great 
value to education. The factors found most amenable to improvement are 
the three fluency factors. The other broader factors are also capable 
of improvement but perhaps require more training or specialized training. 

"Another hypothesis stated that the cognitive factors act as the 
common elements in the transfer situations. This hypothesis was not 
adeq.uately proved; nevertheless;; it does appear tenable since none of 
the results of the study conflicted with it. The hypothesis may possibly 
be validated by a replication of this study or by using a different 
experimental design. This ’'•ypothesis was partially validated, but not 



rigorously, in that in several cases an increase in the mean factor score 
of a group of individuals resulted in the corresponding increase in the 
mean score of all tests loaded on that factor. 

"The factor analytic, approach to the problem of determining the 
effe-?ts of specific training appears to be a useful tool with which to 
proceed in further investigations of other aspects of school learning. 

The research design used in this study has developed, it is believed, 
into a sensitive instrument for measuring and assessing individual 
abilities and differences. Such a design could also be used to investi- 
gate the differential effects of training in other cognitive ability areas 
as well. It remains for future educational research to proceed along 
these lines, making use of the factorial approach to learning and to 
transfer, and to investigate the various conditions, teaching methods, and 
curriculums which would produce the maximum amount of improvement. Various 
teaching methods need to be reappraised in this light. This factorial 
design, by noting the areas of improvement, seems to be an appropriate 
technique for examining the various changes due to specific teaching and 
for determining what teaching methods would be best suited for the improve- 
ment of certain abilities." 

This study is considered complete. 



Study VII 

A Study of Home Background Variables 
Affecting Communicative Skills 



One of the most in 5 )ortant studies included in this program of research 
was concerned with home background and early childhood experiences that 
might be shown to be related to the development of communication skills, 
particularly those in speech behavior. This study constituted the second 
part of the doctoral thesis undertaken by Michael Marge, a Research Assis- 
tant during the first two years of the project, already mentioned in 
connection with Study I. That is, having isolated a nmber of significant 
dimensions of communication behavior in Study I , Marge then turned to the 
analysis of data on the early childhood experiences of his sanqple in an 
effort to find relationships. 

The results of this study were reported in Marge's doctoral disserta- 
tion: 

Marge, Michael. Home background influences on the development of oral 
communication skills in children. Unpublished Doctor's Thesis, 
Harvard Graduate School of Education, 1959* 

and also in an article published in a journal: 

Marge, Michael. The influence of selected home background variables on 
the development of oral comnunication skills in children. Journal 
of Speech and Hearing Research, 19 8 , 291-509 . 




For a s-ummary of this study, we quote from the abstract in Marge’s 
thesis. Part of this abstract covers the factor -analytic study that has 
already been summarized under Study I. 

"The study of verbal behavior has achieved a position of increasing 
importance in the minds of child psychologists and educators. Language 
ability conceived as an integral part of the personality structure of an 
individual has been the source of fruitful research about general cate- 
gories of human behavior. Therefore, as in the case of the research 
reported here, the development of language is studied in its relationship 
to antecedent influences on personality development. The interest of 
this investigation concerns parental behavioral and attitudinal variables 
in their relation to the growth and pattern of child behavior. Specifi- 
cally, the study focuses upon certain home background factors as possible 
antecedents of the development of speaking skills in preadolescent 
children. 

"An extensive review of the clinical and research literature of 
home backgroimd influences on personality and language development led 
to the conclusion that an association between early home practices and 
parental attitudes on the one hand, and the child’s language growth, on 
the other, does exist, though a direct cause-effect relationship is 
generally not reported. Mar^r intervening influences, some which have 
never been identified, either lessen or accentuate the effects. 

"Three theoretical constructs representing home background 
influences— Permissiveness vs. Strictness, No Demands vs. Hi^ Demands, 
and Techniques of Training for Iniplementing the Demands— were selected 
as the antecedent variables. The first antecedent variable, that of 
Permissiveness vs. Strictness, refers to the degree to which the parent 
circumscribes and limits the child’s physical and psychological behavior. 
The second construct. No Demands vs. High Demands, refers to the kinds 
of standards of behavior and achievements which the parent sets for the 
child at different ages and developmental stages. Techniques of Training, 
the third theoretical construct, represents all the practices which the 
parent employs in order to implement her demnds. Each of the three con- 
structs contained a number of specific scales, which, in combination, were 
felt to represent the dimension underlying the construct. 

"The experimental sample was comprised of 1^5 eleven yeax old sub- 
jects, their parents and their teachers. Although extensive data were 
collected about these youngsters when they were intensively studied 
three years previously in the Harvard-Newton Reading Study, further 
information about specific home influences on speech development and the 
speaking abilities of the children had to he obtained in order to meet 
the needs of the research design. 

"Three basic testing instruments were developed: the Parent Ques- 

tionnaire, the Teacher Rating Form, and the Speech Experts’ Rating Form. 
Procedures for testing included the group administration of the Parent 
Questionnaire, which requested information about the child-rearing 
practices and attitudes of the parents toward speech, the administration 
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of the Teacher Rating Form, which requested each teacher of the subjects 
in the study to observe the speech and personality characteristics of 
the child and rate him on a number of behavior scales, and the administra- 
tion of the Speech Skills Battery, which was conducted by the experimenter 
in both individual and group sessions with the children and which yielded 
a number of important scores of speech skill as well as a tape recording 
of the subjects' speech which was later rated by two speech specialists 
on the Speech Experts* Rating Form. 



"An intercorrelation matrix of forty speech variables felt to repre- 
sent the dimension of speaking ability was computed. This was submitted 
to a factor analysis by means of the principal axes method. The resulting 
factor matrix was then rotated by the Carroll oblimin method. 



"Seven factors were extracted which were interpreted as follows: 



"Factor 1 - General Speaking Ability as assessed by Speech Experts: 
described by a need for oral expression, free from distraction and hesita- 
tion phenomena, and originating from an extensive supply of linguistic 
responses. 

"Factor 2 - Motor Skill in Speaking: described by tasks calling for 

the rapid repetition of syllables. 

"Factor 5 - Speech Dominance: described by the monopolizing, domi- 

nating, overwhelming type of behavior in oral communicative situations. 

"Factor 4 - Non-distracting Speech Behavior: described by verbal 

characteristics of speakers which do not draw attention to how the com- 
munication is presented. 

"Factor 5 “ Voice Quality; described by articulation, pronuncia- 
tion and fluency as well as pleasantness of voice. 

"Factor 6 - Language Maturity in Speech Examination: described 

by grammatical usage, pronunciation, conqplexity of sentence structure and 
vocabulary - speech elements which are criteria of the level of language 
development of an individual. 

"Factor 7 “ General Speaking Ability as Assessed by Teachers: 
similar to Factor 1 in the type of ability represented. Variables load- 
ing highly on this factor are from the Teacher Rating Form. 

"Three of these factors. Factors 1, 6 and 7. were considered most 
pertinent for the purposes of this study and therefore, factor scores 
were computed for each of the subjects on the three factors. These 
factor scores were used as criterion measures of speaking skill. 

"intercorrelations of the antecedent variables and the three cri- 
terion measures were obtained and studied in view of the formulated 
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hypotheses which predicted positive curvilinear relationships* between 
the ’permissiveness’ and 'demands' variables on the one hand, and Factor 
Scores 1 and 7 on the other, while linear relationships were expected 
between these antecedent variables and Factor Score 6. Technique vari- 
abXes were expected, to relate linearly with each of* the three criterion 
measures . 



"The following are the results of the analyses: 

"(l) Permissiveness of mothers as defined by this thesis was found 
to be unrelated to the development of general speaking ability in older 
children. But permissive mothers were found to have children who achieve 
higher scores in language maturity. The results further suggest that 
boys -who achieve higher speaking scores have been exposed to warm, indul- 
gent and permissive types of child-rearing practices, whereas girls with 
better speaking skills were found to come from homes which were cold and 
stricto 

"(2) Parental demands were not found to be strongly related either 
to general speaking ability as evaluated by speech specialists or to 
language maturity. However, a marked relationship was discovered between 
parental demands and general speaking ability as assessed by teachers. 

The best single demand predictor of each criterion measure was Expecta- 
tions in Education for the Child by the Mother. 

'’(5) Generally, greater uses of techniques of speech training in 
the home did lead to higher scores on general speaking ability as rated 
by both the speech specialists and the teachers. Use of speech training 
techniques did not seem related to Factor Score 6, Language Maturity in 
the Speech Examination. 

"(4-) The difference between the ratings of speech specialists and 
teachers was explained in terms of the nature of the test situation and 
of the types of cues available to each in the process of evaluating the 
speaking ability of the subjects. The meas\ires which constitute Factor 
1 are speech experts' ratings of a two-minute impromptu talk given by the 
subject in a personal speech examination by the experimenter individually 
Factor 7 is comprised of measures based on teachers’ ratings of the sub- 
ject's speech performance in the classroom. In these ratings teachers 
were felt to have relied, in part, on cues from their knowledge of the 
child's IQ, home background, social popularity and achievement, whereas 
the speech experts had to rely onty on cues furnished by a speech 
reccxrdingo 

"Suggestions for future research include the development of ante- 
cedent variables represented by factor scores obtained from a factor 



^•’’Positive curvilinear relationship" is used here to mean that as 
the antecedent variable increases, the consequent variable increases up 
to a certain optimum point; after that point, as the antecedent increases 
the consequent decreases. 
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analysis of home hackground variables; longitudinal studies of child 
language development; the study of peer-group influences on the speech 
behavior of the pre adolescent; a study of speech training methods which 
can be readily adopted by the public school to help improve speaking 
skills in children; and an investigation of the language abilities of 
the mother, father and child in their relation to home background influ- 
ences on language growth.*' 

This study is regarded as complete. 



Study VIII 

Factor Analysis of Verbal Ability Variables in 
Relation to Written Communicative Skills 

The number VIII was assigned to the factor-analytic phase of 
Weinfeld's study, already described under Study VI, which see. 

Therefore, this study is regarded as complete. 



Study IX 

Factor Analysis of Speech and Personality 
Variables Measured in Study VII 



After the completion of Study VII (Michael Marge) it was thought 
that the relations between the speech variables and the personality and 
background variables might be clarified by a factor -analytic approach. 

On re-examination of the correlations, however, it was decided that the 
approach taken by Marge, i.e., interpretation of the correlations between 
antecedent variabiLes and factor scores had been adequate and that a new 
factor analysis would do little more than reconfirm the relationships 
identified by Marge. 

This planned study, therefore, was dropped. 
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study X 

Relations between Personality and Written Composition Style 



This study was planned as a sequel to Study III. Rather than using 
literary productions of professional writers to identify style factors, we 
pls,nned to rate style factors from high school students' compositions, and 
at the same time study the relation of these factors to scores on personal- 
ity tests and other data. 



Method 



Sample . The Ss were boys and girls in the 10th, Uth, and 12th grades 
of the senior high*”school. pf a semi -rural suburb (Lynnfield, Mass.) in the 
Boston metropolitan area. All students in these grades were tested, but 
some cases had to be eliminated because of incomplete data for various 
reasons— absence on one testing day, failure to finish one or more of the 
tests, etc. The data presented here are based on N's ranging from 100 to 
156 for the boys, and 96 to 1^5 for the girls. 

Measures . The measures may be considered under three categories: 
personality tests, self-ratings of personality, and theme ratings. 

1. Personality tests . Two personality tests were given, the Minnesota 
Counseling Inventory (mCI) and the Guilford-Zimmerman Temperament Survey 
(GZTS). Scores for each S on I8 personality scales were thus obtained- - 
eight from the MCI and 10*”from the GZTS. Raw scores were used in the analy- 
sis, as the GZTS standard scores are grouped in five-point intervals and 
consequently the criterion of continuity could not be met for the subse- 
quent correlational analysis. Because the same raw score may indicate the 
presence of different degrees of a particular characteristic for the two 
groups, the analyses were done separately for boys and girls. 

2. Self-ratings . The £s were asked to rate themselves on 21 bipolar 
seven-point scales in semantTc differential format, as follows: 



1 . 

2 . 

*5. 

* 4 . 

*5. 

* 6 . 

7 * 

8 . 

9 * 

* 10 . 

*11. 

12. 

*15. 



excitable - calm 
messy - neat 
subtle - obvious 
serious - humorous 
earnest - flippant 
rational - emotional 
immature - ma,ture 
insensitive - sensitive 
tense - relaxed 
affected - natural 
interesting - boring 
sincere - insincere 
conqplex - simple 







- 1 ^ 0 - 



1^. sociable - imsociable 
*15* unpleasant - pleasant 
l6. careful - careless 
*17 • disorderly - orderly 
*l8. wordy - not wordy 
*19* personal - impersonal 

20. competitive - cooperative 

21. follower - leader 

The scales indicated with an asterisk (*) were identical to scales also used 
in the theme ratings (to be discussed below), except that the theme rating 
scale con V- spending to No. l8, "wordy - not wordy" was "wordy - succinct." 

The directions to the Ss were as follows: 

"The pijrpose of this test is to determine what you think about 
yourself. On the following page you will find the word ’me' and below 
it a set of scales* You are asked to rate yourself on each of these 
scales in exactly the same way that you rated the voices you heard 
earlier [this has reference to Study II, which also used these subjects] 

"Your answers are confidential and, as all materials are coded by 
momber as soon as they are received, nobody will be able to see how you 
rated yourself. If there are any scales on which you strongly object 
to rating yourself, skip them. Remember this material is for research 
purposes and the value of this study depends upon your answering as 
accurately and honestly as possible." 

3* Theme ratings . In preparation for the obtaining of these measures, 
a TA.T-type photograph was made especially for this project (Figure l). 

Copies of this photograph were offset-printed and included in the Ss' test- 
booklets. Ss were asked to write a story for which the picture could be 
used as an Tllustration. The instructions were as follows: 

"in this part of the experiment, you are asked to use your imagina- 
tion in creating a story. On the following page you will find a picture 
We want you to write a story such that this picture could be used as an 
illustration for it. Tear the picture out of the booklet so that you 
can refer to it as you write. (Turn the picture in with your booklet at 
the end of the experimental session. ) 

"DO NOT MERELY DESCRIBE THE PICTURE. Try to invent an interesting 
story about it. The way you write the story is completely up to you. 
However, we suggest that you try to include what had led up to the sit- 
uation, what is happening now, and what the outcome will be. Do your 
very best. 

"Write your story on the ruled paper provided, and if possible use 
only one side of each sheet. However, if you run out of paper, use the 
back of the pages you've already written on." 



iTgynayaita, 













Fig* 1. Phcbograph used as st iniulns for students* free 
ccxi^sltlons • 
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In giving the Ss the task of writing an imaginative story, it was 
hoped that they would exhibit personal characteristics in their handling 
of the story in a way that might not occur if their task involved simple 
exposition or argumentation. 



The resulting stones were inspected and a few whxch were not of 
sufficient length to make ratings possible were discarded. The remaining 
stories were then rated by four raters on 27 scales. Six of the scales 
were designed to be ratings of the content of the passage, while l8 were 
designed to be ratings of the "style” of the passage. Twenty of the 
scales were chosen from those used in a study of dimensions of prose style 
in a sample of 150 passages of English prose (see Study III). Erom each 
of five factors identified in that study, the four scales having the high- 
est loadings on the factor were chosen. A sixth factor, Characterizing- 
Narration, yielded no loadings greater than .17 on any rating scales in 
the previous study and was therefore not considered here. Table 1 presents 
the scales used in this study and the key loadings that had been obtained 
on the five factors of style in the previous study. The aim was to obtain 
evaluations of the Ss’ stories on the several dimensions found to be 
descriptive of prose style. 



Table 2 presents the complete set of theme -rating scales used in the 
present study, in the form in which they were presented to the raters. As 
may be noted, the semantic differential format was utilized. Scale A, at 
the head of the form, was included as a check on the extent to which the 
Ss followed directions, but results from this scale were not included in 
the correlational analysis. Scales 25 and 26 were included for the pur- 
poses of another study for which the same students were being used as sub- 
jects. Four additional scales that were not derived from the previous 
study (scales 1, 5^ 15 ^ and 21) were included to get at postulated dimen- 
sions not covered or not fully covered by the other scales. For example, 
scale 15, orderly-disorderly , was added to the list to provide a measure of 
compulsivity. 



T>ie four raters, who were teachers or college graduates with advanced 
work in English, were given written instructions similar to those used in 
the previous study of literary style (Study III). It was emphasized to 
them, however, that since they were not rating the work of professional 
writers, they should interpret their standards in such a way as to use the 
full range of ratings on each scale with respect to this particular set of 
stories. Each rater met with the experimenter, rated one story, and dis- 
cussed the scales and the method of making ratings. The final score on 
each scale for each subject was the total of all four ratings. For a small 
number of stories that were rated by only three raters, the scores were 
prorated to estimate what the score would have been with four ratings. (No 
study of the reliability of these ratings has been made, but the communali- 
ties of the final ratings in the factor analysis provide lower-bound esti- 
mates for their reliabilities. ) 



Procedure . All data were gathered in two testing sessions, separated 
by a period of a few months. The two personality tests were given in the 
first session, which was of about two hours' length. A number of Ss could 



Table 1 



Key Loadings of Twenty Theme Rating Scales on 
Factors of Prose Style in Study III 



Scale 


Factor 


General 

Stylistic Personal Ornamen- Abstract- Serious - 
Evaluation Affect tat ion ness ness 

ABODE 


good— bad 


.95 


pleasant— unpleasant 


.88 


strong- -weak 


.88 


interesting— boring 




personal— impersonal 


.85 


intimate — remote 


.82 


emotional — rational 


.77 


vigor ous —plac id 


.65 


florid — plain 


.66 


succinct — wordy 


-.65 


lush — austere 


.55 


natural— affected 


-.51 


subtle- -obvious 


\ . .72 


abstract— Conors be 


^ .64 


complex — s imple 


.51 


profound — superficial 


.41 


earnest— flippant 


•71 


serious —humorous 


•70 


masculine— feminine 


.58 


meaningful— meaningless 


.41 



Table 2 



Rating Sheet for Style Saii5)les 

A. Type of Passage 

Picture Description :::::: 

CONTENT ratings: Characterize the content or subject 

matter of the passage. 



Style Sanqple 



story 



1 


morbid 


2 


abstract 


5 


happy 


k 


subtle 


5 


superficial 


6 


meaningful 


STYLE ratings : Cl 


7 


wordy 


8 


simple 


9 


boring 


10 


flippant 


11 


remote 


12 


vigorous 


15 


plain 


Ik 


weak 


15 


orderly 


16 


humorous 


17 


pleasant 


18 


austere 


19 


affected 


20 


good 


21 


optimistic 


22 


impersonal 


25 


rational 


2 k 


feminine 



gay 

concrete 

sad 

obvious 

profound 

meaningless 

le passage, 
succinct 
complex 
interesting 
earnest 
intimate 
placid 
florid 
strong 
disorderly 
serious 
unpleasant 
lush 
natural 
bad 

pessimistic 

personal 

emotional 

masculine 



Rater 



25 AUTHOR 

evaluates 

26 CHARACTERS IN STORY 

evaluate ; : 



is indifferent 



are indifferent 
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not finish them in the time allowed, and were called from study halls to 
complete them a few days later. During the second testing period, Ss first 
wrote their stories, and then completed the self-ratings. (They al^o per- 
formed some tasks for another study . ) The £s were in their homerooms for 
the experiment; instructions for the testing were read over the school's 
public address system. The long period between the administration of the 
personality tests and the collecting of themes and self-ratings probably 
insured a greater degree of experimental independence between the measures; 
students were at no time told that the study concerned relationships 
between the personality measures and the performance on written composition. 

Method of Analysis . Separate correlational and factor analyses were 
made for boys and for girls. Each correlation matrix had 68 variables: 

26 theme-ratings, 21 self-ratings, 10 scales from the GZTS and 8 scales 
from the MCI. No transformations of variables were made; ordinary 
Pearsonian product -moment correlations were computed by a "missing data" 
routine that permitted each correlation to be based on the number of cases 
8<^8<il8<ble for that correlation. (Because of the large number of correla- 
tions involved, no investigation of possible curvilinearity of regression 
was made.) Factor analysis was accomplished by the principal components 
method using initial estimates of communalities based on the highest abso- 
lute value of a correlation in each array; varimax rotations were performed 
on the characteristic vectors having latent roots greater than unity. 

Results 



The correlation and factor matrices resulting from these analyses are 
on file. Only the ma;jor results will be summarized here. 

In the case of both the boys' and girls' matrices, 12 vectors had 
latent roots greater than one. All rotated factors were "interpretable"; 
it .•'s possible, therefore, that more factors could have been rotated. 

Table 5 shows the mean, S.D., and communality for each variable for 
boys ^ and the comnnuialities only for girls. Unfortunately, the means and 
S.D.'s for the gj.rls are not available at this writing, the relevant data 
sheets having been lost. 

As noted earlier, the communalities provide a lower -bound estimate of 
the reliabilities. For the boys, communalities of theme -ratings range from 
.556 to .959^ with a median at .802; for the girls, they range fr-om .4-75 to 
.950 with a median of .805« There is a suggestion in the data that the 
communality is partly a function of the amount of variance. But a more 
interesting finding is that among the variables that have highest communal- 
ities (hence, probably, highest reliabilities) are the scales having to do 
with the ev^uative dimension — good-bad, weak- strong . pleasant-unpleasant . 
and b or irig-inter es t ing . This contrasts with the finding of Study III, in 
which it was reported that ratings of the Evaluative dimension had rela- 
tively low reliabilities. In that study, however, the variar.ces of ratings 
on the Evaluative dimension were probably relatively low, possibly because 
most of the passages rated were published writings by professional writers. 
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Table 5 



Means, S.D.'s, and Coimmmalities for Variables in Study X 



Boys 



Girls 



•iable 

No. 


Description 


Mean 


S.D- 


,2 

n 




1 


Theme -Ratings^ 
morbid— gay 


15.72 


k .66 


•855 


.868 


2 


abstract — concrete 


20.61 


5.70 


•‘^55 


.655 


5 


happy — sad 


160 4.7 


i ^.07 


.879 


.885 


k 


subtle — obvious 


18.79 


5.5^ 


•593 


.728 


5 


superficial — profound 


11.60 


5.08 


.654 


.701 


6 


meaningful — meaningles s 


15.55 


5.62 


.635 


. 64-7 


7 


wordy — succinct 


16 . 4 - 4 - 


5.99 


.512 


.605 


8 


simple — con5>lex 


15.68 


4 .. 68 


.769 


.807 


9 


boring — interesting 


17.58 


4 -. 85 


•937 


.878 


10 


flipp.uit — earnest 


18.85 


5.96 


.886 


.84.7 


11 


remote — intimate 


15.10 


5.09 


.918 


.868 


12 


vigorous — placid 


15.79 


4.. 87 


.825 


.718 


15 


plain— florid 


15.59 


i ^.50 


. 84-5 


.896 


Ik 


weak — strong 


16.67 


5.66 


.959 


.926 


15 


orderly — disorderly 


15.65 


4 -. 68 


.799 


.707 


16 


humorous — serious 


19-55 


5.11 


.891 


.852 


17 


pie as ant — unpleasant 


15.76 


4 -. 4-9 


.907 


.896 


18 


austere — lush 


li ^.65 


2.82 


.786 


.828 


19 


affected — natural 


19.09 


5 . 64 - 


.682 


.692 


20 


good — bad 


15. 


5.5^^ 


.958 


.950 


21 


optimistic — pessimistic 


15.^2 


i ^.02 


.805 


.805 


22 


imper s onal — per s onal 


li^. 5 ^ 


5.^5 


.905 


.871 


25 


rational — emotional 


li^.08 


5.72 


.4.76 


.^75 


2 k 


feminine — masculine 


18.78 


5.4.7 


.556 


.4.78 


25 


author: evaluates — is indifferent 


li ^.78 


4..97 


.621 


.601 


26 


characters : evaluate — are indif- 


10.89 


6.10 


.621^ 


.599 



Self-Ratings : 



>f' ♦_ m2 
ivie 



27 


excitable - ~c aim 


5.77 


1.72 


. 4-19 


.5^9 


28 


messy — neat 


k -97 


1 . 54 «^ 


.510 


.605 


29 


subtle — obvious 


k.Ol 


1.55 


.256 


.691 


50 


humorous — serious 


5.08 


1.4.9 


.155 


.817 


51 


earne st —flippant 


5.56 


1.49 


•k 33 


.602 


52 


rational — emoti onal 


5.97 


l.k 9 


.kkl 


.651 


55 


immature — mature 


5.56 


1.15 


.578 


.612 


J}k 


insensitive — sensitive 


^.75 


l.i ^9 


.575 


.285 


55 


tense— relaxed 


i^. 4-8 


1.67 


. 4-71 


.532 


56 


affected- -natural 


5.11 


l.i ^9 


.549 


.24.5 


57 


interesting — boring 


5.59 


1.18 


.4.78 


.252 


58 


sincere — insince'^ 3 


2.65 


1.11 


. 4-26 


.501 


59 


complex — simple 


5.52 


1.26 


.177 


. 8 i ^9 
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Table 3 (continued) 



Variable 

No. 



Boys 



Girls 



Description 



Mean 



S.D. 



40 

kl 

k2 

43 

^5 

46 

47 



48 

49 

50 

51 

52 
55 
5^ 

55 

56 

57 



58 

59 

60 

61 

62 

63 

64 

65 



sociable — unsociable 


2.60 


1.36 


.551 


.73^ 


unpleas ant — pleas ant 


5.54 


1.05 


.57^ 


.592 


careful — careless 


3.24 


1.56 


.501 


.668 


dis orderly- - orderly 


4.92 


1.52 


.576 


.718 


wordy- -not wordy 


4.20 


1.66 


.326 


.695 


personal — impersonal 


5.49 


1.31 


. 265 


.591 


competitive- -cooperative 


5.90 


1*75 


.165 


.578 


follower— leader 


4.92 


1.29 


.475 


.151 


Guilford-Zimmerman Temperament Survey (raw 


scores ) 






General Activity 


15-96 


5.^5 


.598 


.585 


Restraint 


12.50 


4.62 


.6o4 


.445 


Ascendance 


15.04 


5.12 


.637 


.550 


Sociability 


17.16 


6.28 


.745 


.362 


Emotional Stability 


16.25 


4.80 


.522 


.570 


Objectivity 


■ 15.23 


5.59 


.629 


.487 


Friendliness 


11.56 


4.91 


.515 


.310 


Thoughtfulness 


16.10 


5.57 


.464 


.497 


Personal Relations 


l4.8o 


5.23 


.452 


.505 


Femininity 


19.00 


3.60 


.312 


.361 


Minnesota Counseling Inventory (raw 


scores) 








Validity 


5.51 


2.09 


.289 


.675 


Family Relationships 


10.37 


7.19 


•571 


.419 


Social Relationships 


20.70 


11.07 


•757 


.558 


Emotional Stability 


13.06 


6.38 


.724 


.613 


Conformity 


15.63 


4.28 


.601 


.515 


Adjustment to Reality 


12.61 


7.54 


•757 


.155 


Mood 


11.99 


4.26 


.688 


.295 


Leadership 


12.23 


5.17 


.690 


.431 



^ean Ratings on a scale from 4 to 28 vrith a logical mi.dpoint at I6; 

4 corresponds to maximum degree for left end of scale (e.g.^ idaximum morbidity 
for scale l), 28 to maximum degree for right-hand end of scale. 

^ean Ratings on a scale from 1 to 7 with a logical midpoint at 4; 
interpretation similar to that for theme -ratings. 
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In the present study, it is noteworthy that apparently reliable style 
ratings were obtained for many of the scales presumably measuring style 
factors other than Evaluation. Two or more of the scales for the factors 
Personal Affect, Ornamentation, Abstractness, and Seriousness had comiuunal- 
ities above the median. From this evidence, it may be conducted that themes 
obtained from high school students can be reliably rated on style factors. 

From the mean theme ratings (on a scale running from 4 to 28 with a mid- 
point at l6) it may be seen that most of the mean ratings tended to cluster 
around the midpoint. The only ratings that fell outside the zone correspond- 
ing to the midpoint ± one point on the original 7 “P 0 int scale were those for 
abstract— concrete (the themes were quite concrete ) and super fi cial. — pr of ound 
(they tended to be rated as superficial ). (As noted above, no data are 
available for the girls. ) 

The comraunalities of self-ratings were generally lower than those for 
the theme ratings. This is to be expected from the fact that they were 
single ratings rather than values pooled from the Judgments of several 
raters. For the boys, the communalities ranged from .155 to .57^ with a 
median at .419; the girls' communalities ranged somewhat higher, from .151 
to .849 with a median at .602. The rankings of the variables with respect 
to comraunality were quite different; for example, the scale complex-simple 
had the highest comraunality for the girls but one of the lowest for the boys. 

As might be expected, the mean self-ratings for the boys tended to lie 
toward the favorable ends of the scales; there was sufficient variance, how- 
ever, to peimit meaningful intercorrelations. 

The communalities of the personality scales were of substantial magni- 
tude, permitting the inference that the scales were sufficiently reliable to 
provide useful assessments. 

Factor Analytic Results . In the main, the factor patterns for the boys' 
and the girls* matrices were similar, although there were a number of dissim- 
ilarities. The major finding that was pertinent to the objective of this 
study was that there were few, if anj’’, substantial relations between style 
ratings of the written con^ositions and any of the personality measures ^ 

The factors obtained stemmed either from the theme ratings or from the per- 
sonality measures (personality inventories or self-ratings) but not from 
both. Indeed, there were few relationships between any of the personality 
inventory scores and the self-ratings. 

For purposes of exposition, we will organize the factor -analytic re- 
sults according to the sources of the factors, taking up first the factors 
derived principally from the theme ratings. 

Six of the 12 factors from the two matrices (i.e., the boys* and the 
girls ’ ) were factors that were found in both matrices and that could be 
identified as deriving almost exclusively from the theme ratings. We will 
list the vjjriables identifying each of these factors and display the load- 
ings equal or greater than .30 in at least one of the matrices. When bipolar 
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scales nre mentioned, it is to be tinderstood that the loading applies to the 
first-mentioned or left-hand end of the scale. (Some scales and factors have 
been reflected through the origin to facilitate interpretation. ) 



Themes : Evaluation 


Loadings 


i 


Variable 


Boys 


Girls 


*strong-weak 


•95 


•94 


*good-bad 


•95 


•95 


*interesting-boring 


•92 


•91 


*ple as ant -unpleas ant 


.87 


.84 


order ly-di s orderly 


•79 


.67 


vigorous -placid 


.69 


•70 


me aningful-me aningle s s 


.68 


•52 


profound-superficial 


•58 


•55 


complex-simple 


•52 


.60 


characters evaluate 


• 45 


.48 


subtle -obvious 


•55 


•57 


florid-plain 


• 50 


•57 


intimate -remote 


.26 


.44 


wordy-succinct 


-.40 


-.28 


per s onal -imper s onal 


(•19) 


.54 



The scales marked with an asterisk were those chosen from the previous study 
to represent the Evaluation factor, and it is noteworthy that in both matrices 
they had the highest loadings on this factor. These can be relied on to pro- 
duce measures of the Evaluation factor. 

Theme; Ornamentation vs Plainness 



*lush-austere 


.84 


.87 


*florid-plain 


•85 


.86 


*affected-natural 


•74 


•77 


complex-simple 


.64 


.65 


subtle -obvious 


.64 


(. 22 ) 


abstract-concrete 


•58 


(. 28 ) 


*vror dy-succ inct 


.47 


.69 


emotional-rational 


.44 


.46 


profound-superficial 


• 58 


(•09) 



The scales marked with an asterisk were the reference scales, and had high 
loadings only on the Ornamentation factor. 

Theme: Humor vs Seriousness 



*f lippant -e arne s t 


.87 


.88 


*humorous -serious 


•87 


.84 


vigorous -placid 


•55 


.28 


%as culine -feminine 


-51 


-57 


*meaningful-meaningle s s 


(-27) 


-51 
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Of the scales selected from the previous study, only the first two had 
high loadings; the other two are apparently not highly valid measures of 
this factor. 



Theme; Personal Affect 



*per s onal-impersonal 


.89 


.84 


*int imate -remote 


.87 


.80 


*emot ional-r at ional 


.41 


(•25) 


mas culine -feminine 


(-05) 


.50 



The scal^ vigorous -placid, included to help identify this factor, did not 
appear on the factor in this study. 

Theme: Abstractness -Concreteness (found only in girls' matrix) 



*abstract-concrete 


•70 


^subtle -obvious 


.66 


^profound -superficial 


.48 


emotional -rat ional 


.25 



Contrary to expectation from the previous study, the scale complex-s imple 
did not appear on the factor. The failure to find the Abstractness - 
Concreteness factor in the boys' matrix may have been due either to lack 
of sufficient variance on the relevant scales among the boys' themes, or 
to a failure to use a sufficient number of factors in the rotations. 



Theme : Optimism 



happy-sad 


.92 


.92 


gay-morbid 


.89 


•91 


optimistic -pessimistic 


.87 


.86 


pleas ant -unpleas ant 


.55 


.34 


vigorous -placid 


-.30 


(-25) 


mas culine -feminine 


(-22) 


.32 


This was a factor that had not appeared in the 


previous study but was 


defined mostly by scales that were 
time. 


introduced : 


in this study for the first 


Theme; (Doublet for author vs 


. character 


evaluation) 


Author evaluates — is 


indifferent 
Characters evaluate — 


.74 


•70 


are indifferent 


-.60 


-.48 


Me : Follower -Le ader 


(.08) 


-.32 



This is labeled a doublet because it apparently represents simply a dimen- 
sion created by the fact that the raters were asked to indicate whether any 
"evaluations" made were made by the author or by the characters of the story. 
Nevertheless, this factor was the only one of the theme factors that exhibited 
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any significant loadings on any of the self-ratings. It would appear that 
students (girls, at least) who rate themselves as "leaders” tend to write 
stories in which they themselves make value judgments, rather than letting 
their characters do so. Nevertheless, this tendency is very slight and 
its significajice would have to he confirmed in a replication study. 

We next take up the factors identified as derived primarily from the 
self-ratings. Because of missing data in the girls' matrix and difficulties 
with computational routines, the available data for girls do not appear to 
be correct and therefore the results for girls will not be presented. 

Self-Ratings : Boys : Disorganization? 



car e le s s -car eful 


.66 


messy-neat 


.61 


flippant -earne st 


.58 


disorderly-orderly 


•50 


insincere-sincere 


.48 


immature -mature 


.44 


follower-leader 


.43 


GZTS : Restraint 


.36 



Self-Ratings : Boys : Self Perceived as Rational, Calm 



rational-emotional 


.61 


calm-exc itable 


.61 


relaxed-tense 


.54 


insensitive-sensitive 


•55 


subtle-obvious 


.31 


GZTS : Femininity 


.41 


MCI : Emotional Stability 


-32 


GZTS: Emotional Stability. 


-.30 


MCI: Mood 


-.30 



Self-Ratings : Boys : Pleasant Sociability 



pleas ant -unple asant 


.66 


sociable-u .isociable 


.64 


interesting -boring 


•57 


personal-impersonal 


•37 


leader-follower 


• 30 



Factors primarily derived from personality test scores are next given, 
but only for the ooys' matrices since the available girls' matrices are 
very probably in error. 

Personality Tests: Boys: Ascendant Sociability 



MCI: Social Relationships .8o 

GZTc^: Sociability .79 

MCI: Leadership „71 

GZTS : As c endance , 7 l 
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MCI: Mood 


.67 


GZTS: General Activity 


.50 


MCI : Emotional Stability 


.55 


MCI: Adjustment to Reality 


.28 


Self-rating: follower-leader 

Self-rating: sociable- 


.5^ 


unsociable 


-.52 


It is noteworthy that the self-ratings 


of leadership and sociability are 


somewhat negatively correlated with corresponding scores on the personality 
tests. There were no significant loadings of this factor on theme -ratings. 


Personality Tests: Boys: Good Adjustment 


MCI : Conformity 


•7^ 


MCI: Adjustment to Reality 


•71 


GZTS: Ob;Jectivity 


.69 


MCI : Family Relationships 


.68 


GZTS: Friendliness 


.65 


MCI : Emotional Stability 


.61 


GZTS: Emotional Stability 


.55 


GZTS: Personal Relations 


.50 


MCI: Validity 




GZTS: Restraint 


.55 


Personality Tests: Boys: Thoughtfulness and Restraint 


GZTS: Thoughtfulness 


.65 


GZTS: Restraint 


.52 


MCI: Validity 


-.55 


GZTS: Personal Relations 


.31 


Self-rating: insensitive- 




sensitive 


.38 


Theme-rating: masculine - 




feminine 


.33 



The loading of this factor on the masculine -feminine theme-rating is one of 
the few cases in which there was any relationship exhibited between person- 
ality test scores and theme -ratings . It suggests that boys who score as 
thoughtful and restrained tend to write themes which give the impression of 
’'masculinity. " The actual correlations underlying these findings are .270 
^masculinity-femininity and GZTS Restraint; N = 155, £ *01) and .209 
(masculinity -femininity and GZTS Thoughtfulness; N = 155; £ < *05). 

Discussion and Conclusions 

One major result of the study is the finding that high-school students* 
written themes can be reliably rated on a number of "style" factors: 
Evaluation, Ornamentation, Humor, Personal Affect, Abstractness, and 
Optimism. Most of these style factors had already been identified in the 
literary productions of professional writers. Possibly still other "literary 
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style factors could be identified^ either in high-school students' themes 
or in other kinds of literary productions, by the use of appropriate rating 
scales . 

The other major result of the study is the finding that at least in the 
case of a particular theme-writing task (writing an imaginative narrative in 
response to a picture), there were few if any significant relations between 
rated style factors and a series of fairly ccaaprehensive personality tests 
and self-ratings. Since this was simply an exploratory study, there was no 
prior theory that there would be any such relationships.;, it was simply de- 
sired to det'^irmine whether such relationships woiild be readily apparent in 
an exploratory study. 

Since the relationships did not appear to be significant (with a couple 
of minor exceptions), the following hypotheses are suggested for further 
investigation: 

(1) Rated style factors are specific to particular kinds of writing 
tasks and would not have generality over the total writing output of an 
individual. 

(2) Even if certain style factors could bo found to have limited gener- 
ality over certain types of writing output, they would not be found to have 
relations with personality variables. 

(5) The relationships between style and personality did not emerge as 
significant in this study because the measures of personality were not suf- 
ficiently accurate or valid. 



Study XI 

Study of Judgments of Children's Personality from Voice Recordings 



This study was planned to examine relations between rated characteris- 
tics of children s recorded voices to attributed personality characteristics 
using data collected in the course of Study VII. Time did not permit the 
completion of this study. 



Study XII 



The memoreuda on the planning of this study are vague; one speaks of a 
stu^ jf certain speech characteristics of adults , ** while another speaks 
cf a study of certain data on parent attitudes toward speech.” In any 
event, the study was never done because of lack of time and funds. 



o 
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study XIII 



(Because of an error of numbering, there was no Study XIII. } 



Study XIV 

Review of the Literatur’e of Speech and Personality 



This was to be an extended document reviewing the literature of speech 
and personality. Although much work was done in assembling and abstracting 
bibliographical material, this review was never written. The materials are 
still in the principal in»/’estigator’s possession and it is hoped that they 
can eventually be shaped into the desired document. 

However, a bibliography that had been assembled prior to the undertak- 
ing of the project is placed in Appendix C for its possible usefulness. 



Study XV 

Verbal Style of Conceptualization and Personality Characteristics 



This study was done by Aaron S. Carton for his doctoral dissertation 
at the Harvard Graduate School of Education (1961). It was done within the 
same context as Study X and utilizec. some of the data obtained in that 
study. 

This study is regarded as complete. Dr. Carton’s summary is included 

here. 



Summary 



Experimentation and research has heretofore concerned itself with the 
relations between speech and personality, or between conceptualizat'J on and 
personality, or between language and thought. This thesis is seen as an 
exploratory contribution to the study of language and thought which approaches 
the problem by studying the relations between two pairs of the related phe- 
nomena; verbal style and personality is one pair, and conceptualization and 
personality is the second pair. The thesis sought to contribute 

(a) a specific taxonomy of verbal styles of conceptualization; 

(b) a specific demonstration of variations due to stimulus conditions 
and stimulus objects, and 

(c) somu specific relationships between personality characteristics and 
our taxonomy of verbal styles of conceptualization. 
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Several descriptions of pictures which were supplied by each member 
of a population of l8 college students and a different population of 8l 
high school students constituted the main source of data used. Paintings , 
by famous artists were used as stimulus objects. The pictures varied in 
style and content, although they were all depictions of relatively large 
groups of people. Several variations in instructions to S^s were employed. 

Rating procedures by judges were developed in successive steps and 
10 scales describing the products, quality, or processes of conceptualiza- 
tion observed in the picture descriptions were formulated. Scores on 
these scales were correlated with Scores made by the high school students 
on 



(a) 10 scales of the Guilford-Zimmerman Temperament Survey (G-Z 
Temperament Survey); ’ 

(b) 8 scales of the Minnesota Counseling Inventory (MCI); 

(c) 27 rating scales of short stories written by the students, and 

(d) 21 self-rating scales on an instrument called "Me." 

Each scale was studied for (a) its inter- judge reliability, (b) the con- 
sistency of Ss scores in respect to several ratings on the scale, (c) its 
variations due to variations in the stimulus conditions and to variations 
in the stimulus objects, (d) its correlations with the other scales. 

Each of the 10 scales utilized in the final study is described briefly 
below. This list retains the number designations of the scales used in a 
pilot study which contained 11 scales. 

Scale 1, alteristic-egoistic, was essentially a measure of the speak- 
er's personal involvement in describing a stimulus. 

Scale 2, amount of manifestation of awareness of own cognitive pro- 
cesses, was concerned with measuring how conscious a speaker is of the 
cognitive processes in which he engages. 

Scale 5^ amount of evaluation, was a measure of the relative number 
of evaluative adjectives and expressions of affect which appeared in a 
description. 

Scale if, degree of organization cf percepts, was a measure of the 
extent to which the speaker would integrate featiares of the stimulus field 
and produce relational concepts. 

Scale 5a, progression of organization, analytic, measured the direc- 
tion of integrations. Scale 5a was concerned with the extent to which 
speakers started with organize! concepts and analyzed them into components. 

Scale 6, degree and amount of inference, was a measure of the extent 
to which a speaker would depart from a literal description of the sense 
data presented to him and make inferences as to events depicted or concepts 
to be formed. 



Scale 7 ^ plain-ornamented, vas an adaptation of a factor of literary- 
style pertaining to the amount of embellishment a speaker tends to employ. 

Scale 8, amount of digression, was a measure of the tendency of a 
speaker to depart from a description of the stimulus object. 

Scale 9^ amo-unt of fictionalization, was a measure of the tendency 
of speakers to fabricate events and relationships on the basis of the 
stimulus field. 

Scale 10, specific -general, was intended to obtain an indication of 
the extent to which a speaker concerns himself -with details and the extent 
to which he concerns himself w3.th more general or gross aspects of the 
stimulus field. 



In the final study the inter-judge reliabilities of the scales for 5 
judges (computed by Ebel's method) ranged from .l4 to .65. The average 
reliabilities, or expected test-retest correlations using an "equivalent" 
set of judges, ranged from .46 to .90. The correlations be-bween pairs of 
protocols for each scale ranged from .09 to .50. 

In one pilot study, 10 picture deso-^lptions obtained by three slightly 
different e:q)erimental techniques were '■;<;udied in respect to 10 high school 
students. Two-way analyses of variance for each scale in which Ss and 
picture descriptions were the variables, revealed that the instructions 
and/or the stimulus objects were a significant source of variation for 
almost all the scales. Findings throughout the thesis point to the fact 
that the length of the protocol is a significant factor in the amount of 
any trait the judges perceive, despite the fact that the measures were 
intended to be relative to the population studied. 

Rather large inter correlations among the scales were observed with a 
high degree of consistency throughout the study. These correlations were 
to an extent built in" to the definitions of the scales. It was pointed 
out, however, in the theoretical sections of the thesis that where rela- 
tively large, complicated, and exhaustive taxonomies are used, and in 
experimental procedures in which Ss were relatively free to choose their 
concepts from a large universe and are unrestricted as to the conceptual 

processes used. Intercorrelations among the concept categories are bound 
to occur. 



Some low, but statistically significant, correlations were found with 
measures. Several of these correlations suggested that some 
of the traits measured by the scales formulated for this thesis were con- 
sistently related to similar traits in the written production of the Ss. 
^her correlations implied the existence of pervasive personality configura- 
tions although considerable further research is required to verify the 
relationships s^gested. Scale h (amount of organization), for example, 
was related to masculinity" on the "G-Z Temperament Survey, " negatively- 
related to leadership" on the MCI. On the self-rating form "Me" it was 
positive^ related to "messy-neat," "immature-mature," "disorderly-orderly," 
and follower-leader. It was negatively related to "careful-careless," 
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and "competitive -cooperative." The configuration of correlations suggested 
that individuals manifesting "organization" in their picture descriptions 
regarded themselves as people who intend to organize matters and keep things 
neat. The fact that the stimulus objects contained representations of 
people is believed to have elicited the relation of the scale with a per- 
ception of one's self as a leader^ although this self -perception is nega- 
tively related to the leadership scale on the MCI. 

The fact that protocols of verbal behavior were used pointed to the 
importance of distinguishing between the processes of assigning exemplars 
to concepts and the attainment and formation of concepts and pointed to the 
necessity of distinguishing between the processes of conceptualization and 
the products of the process. The implications for education were seen to 
be partially in the diaehostic value of the identification of conceptual 
styles for teaching various kinds of subject matter, in the possibility of 
developing techniques for modifying and inproving desired conceptual styles, 
and in the value to teachers of training in identifying conceptual styles. 
The problems for future research were seen as being primarily the establish- 
ment of better objective techniques of measuring the traits, explorations 
of variations of the traits in the presence of experimental manipulations 
and the development of a measurement procedure to study the relative con- 
sistency of a given trait in respect to a single S. The ultimate valida- 
tion of the scales as measures of relevant dimensions of style is expected 
to occur in concept attainment and concept formation experiments and by 
relating the scales to proficiency in the intellectual pursuits which are 
believed to involve the traits. 
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APPENDIX A 



Changes in Perceived Personality Traits as a Function of 
Hanipulations of Vocal Characteristics 2 

Paul H. Kjeldergaard 
Harvard University 

There is a vast literature on the ability of raters (usually untrained) to 

judge personality traits or physical attribute^ from voices. On the personality 

side, attempts have been made to correlate objective rieasures and judges* ratings 

< * * 

on traits such as introversion^ intelligence, sociability, !>eadership, honesty , 
(Fay & laddleton, l^UOa; 19hla5 IShllo; I9h2; 19U3b) dominance, (Eisenberg & 
Zalowitz, 1938), sincerity (Hildreth, 195U)^ pleasant ness, aggressiveness, 
(Starkireather, 19^6), social vs0.ues5 (Allport & Cantril, 193ii) and neuroticism , 
(Taylor, 19^U)« In terms of physical characteristics, raters have been asked 
to judge sex, age, height, ireight , (Pear, 1957), fatigue, ICretschmcrian body 
types (Fay & Middleton, 19l;Ob5 19ii0c]^ and complexioa (Allport & Cantril, 193li)* 

In addition to the personality trait and physical attribute domaj-ns, several 
studies have been concerned x-iith hotf well listeners could judge a speaker *s 
occupation from a recording of his voice# (Pear, 1931, 1937; Fay & Middleton, 
1939; Allport & Cantril, 193U#) One study measured hax accurately a judge 
could natch a speal©r*s voice with his photograph or a handwriting sample 
(Allport & Cantril, 193it)* 

I'Jith two exceptions, raters have had little or no success, in malclng judg- 
ments about any of the aforementioned characteristics on the basis of the voice 
alone. Judges can decide fairly accurately on the s^ of the spealasrs and 
make fairly good estimates of a speaker *s age on the basis of a sample of a 
personas speech. Although judgments on the remaining characteristics appear 
invalid, virtually all of the studies reviewed found hi^ly consistent ratings 
among the judges on all traits or attributes. That is, judges agreed vjifch one 
another that a given speaker liad a certain trait or attribute vxhether or not 
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he did in fact have such a characteristic. This inter judge agreement seems not 
to hold for all voices rated, but seems to be true for a certain subset of 
voices in each study, Iloirever, considering the diversity of judges, of speakers, 
of the number of diaracteristics rated, and of variations in esqperimental pro- 
cedures and conditions in the studies cited, one is coj 5 )elled to look upon this 
finding as a “universal”. This phenomenon, vlhich seems to be tangential to the 
studies reviewed and appears never to have been subjected to systematic investi- 
gation itself, provides the stimulus for the present sutdy* It was felt that if 
these “verbal stereotypes” could be systematically manipulated in some way, per- 
haps this would provide some insist into hoir these stereotypes were fomed and 
perhaps would reflect on attitude formation in general. 

Assuming that the “stereotypes” are somehow correlated with the vocal 
characteristics of the spealcers, an obvious approach to the problem was to 
vary systematically the vocal diaracteristics of the speaker and note the 
corresponding changes in the verbal stereotypes. The possibilities here are 
legion. To mention only a few, one could irith any measurable vocal characteris- 
tic select individuals who had specified amounts of a given characteristic and 
look for changes in stereotypes as the amount of the characteristic increased 
or decreased; one could draw a “sample” of spealters, do a microlinguistic 
analysis of their vocal characteristics, obtain ratings of various traits, and 
resort to a correlational analysis between the two types of measures; one could 
manipulate certaiji vocal characteristics of a voice hy subje cting it to various 
electronic and mfichanical manipulations such as those used in intelligibility 
studies (of, Liciclider & Miller, 19^1) and thereby compare ratings of traits of 
the “nomal” voice with those that had been distorted in various ways. The 
alternative decided upon vxas similar in approach to the 3a tter. tJith neither 
previous research nor relevant theory to point the direction in which to look for 
significant ■»/ariables, it ims decided to use only simple manipulations of the 
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voice vjhich the speaker himself would na!:e* Preliminaiy esqperimentation. with 
various spealcers rapidly led to the conclusion timt rate and loudness could 
be most consistently manipulated across spealcers and this seemed to result in 
noticeable changes in the vocal characteristics of the speech samples t 

Again, because of the lack of the theoretical formulation and Tilth no 
empirical data other than the studies cited indicating that there mi^t be an 
effect to be measured, no specific hypotheses were pub forth. One could formu- 
late specific hypotheses on a ’‘common sense” basis, e.g. an increase in rate 
TTould be accompanied by higher rating on such scales as passive-active « Such 
-predictions, however, trould add little to the study as siipirical differences in 
either direction would prove intrresting and one could probably generate post 
hoc esgplanations for almost any finding* 

Hethod 

Recordings: The stimulus material for the speech samples consisted of a 
307 word passage which had been selected a^ being ’’neutral” irith respect to 
six factors of literary style Carroll, 1$?60). T^renty-one male Harvard 
undergraduates each read the passage four times under four sets of instructions* 
The four conditions or instructions trere ’’normal”, ’’fast”, ’’shouting”, and 
’’soft”. There Tiere no specific rules for the reader tbo follow under each of 
these conditions: hoTrever, the reader iras carefully rehearsed at each stage in 
order to obtain a smooth reading TJhich sounded ’’natural” and yet achieved the 
desired effect* The instructions for tlie ’’normal” condition T-rere to read it 
as he wrould normally read it aloud to a group* For the ’’fast” recording the 
reader was instructed to increase his rate without sacrificing the impression 
that he was trying to communicate something to somebody* The ’’shout” recording 
Tjas obtained by having the reader move approximately t\Jo feet away from the 
microphone and speak as if he T-rerc trying to project in a large auditorium* 
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The ”soft” condition was obtained by having the reader speak within four inches 
of the microphone very softly (just audible) at his normal rate. Appropriate 
corrections were made on the preamplifier to equate the various conditions and 



varioi:» spealcex's in teims of loudness of recording* 



IG.nor adjustriients vTith 



respect to intensity were also made the original tapes were transcribed 
onto the test tape* It should be noted that equating the conditions of a given 
voice in terms of loudness T^as designed to malce it sound as if the four con-' 
ditions represented four speakers with different vocal characteristics, each 
reading the passage in a normal manner* Anecdotal evidence indicates that this 
deception was successful* 

Prom the twenty one recorded voices three iiere selected by the author as 
having the best separation between the four conditions* In addition, two 
other voices were selected as being very different from fee se three. The "normal** 
condition from each of these latter two voices was included to help disguise the 
fact that the raters would be judging the same person several times# 

Heasurements: The instrument used to obtain the rating was the semantic 
differential (cf, Osgood, Suci, & Tannenbaum,19^7)* A pilot study \jas conducted 
using sixty- two scales which seemed to be describing personality traits and 
wliich woro cor.^rchensible by hi^ school students (raters)* On the basis of the 
estimated reliability of the scales and a crude cluster analysis of the correl- 
ation Matrix, seventeen scales were selected for inclusion in the experiiaent* 
Reliability was estimated from^^fie ^tercorrelations with other scales in the 
matrix. Ho scale was included in the study which did not correlate .65 or higher 
Tilth some other scale* 



The polarity of the scales included in the study was randomized and then 
the scales were assigned to four random orders, yielding four different forms 
of the semantic differential © These four forms were randomly assigned to the 
fourteen serial positions in which the speech sar.^les Trere to be presented# 
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This last randomization process Tias restricted in that the same form vs.8 not 
allo^red to occur tTiice in succession* The use of four forms of the semantic 
differential and the restriction on the assignment of these forms to the speech 



Stimulus material: The four conditions from the three voices plus the two 

single conditions from the two other voices TJcie assigned random numbers and then 
these samples ifere transcribed onto a single tape at two and one half minute inter** 
vals in serial order' according to their random numbers* Again tlie randomization 



allowed to occur in succession. This precaution was talcen to help disguise the 
fact that the same voice was being used in several, of the speech samples* 



Directions: The directions for the use of the rating scales were presented 

to the raters both visually and oraldy* EacI’. judge had detailed mimer graphed 
instructions on hoirto use the scales and he was asked 1o read these as tney were 



read to him via the tape* The instructions were a simple adaptation of those 
presented Osgood, Suci, and Tanneribaum (1957, pp. 82 -8U)* 



^ middle class Massachusetts public hi^ s chool. The classes from each of the 
grade levels were randomly assigned to the e^speriment and the ^eech samples 

presented to the Ss over the school PA system* 

Design: The statistical design utilized in this experiment is the splj 

design (Cochran & Cox, 1959 )s the classes are treated as the whole-unit or tr( 
ment variable and the speech samples are considered the sub-unit variable* 
a design takes account of the fact that sub-unit observations are correlatec 
with each other (in this case ratings on tie voices by a given judge are com 
aidered correlated) rnd whole-units (classes) are considered independent. ' 
design gains precision in testing differnces between sub-units (speech samp. 



sarAples was designed to minimize the formation of position habits by the ratar 
arid to force the raters to attend to the scales* 




process w^ls restricted in that two speech samples of the same voice irere not 



Subjects: The judges were senior hi^ school students from a small sub 
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by sacrificing precision in t-sttog differences befciteen whole units (classes). 

It is particularly fruitful here, where one would not e^ect differen^s between 
classes nor would one be very interested in them if they should exist. 

Results 

Ihe results of analyses of variance of the differences among voice conditions 
for each of the seventeen scales are sumaarized in Table 1. Inasmuch as Ss had 
been assigned to classes systenaticd.ly, statistical tests of the whole-units 
(differences among classes) are not meaningfulj therefore, that portion of the 
analysis of variance t ables has been omitted. Certain liBwrtant facts emerge 
from 1, First, for each of the seventeen scales differences in the mean 



Insert Table 1 about here 



ratings of the speech san^ples exist and the magnitude of the P ratios are such 
that the probability that any of these are due to saapling error is extremely re- 
mote. The F ratios indicate that rather large differences exist among the speech 
sajiqjjles rated on each of the seventeen scales. Second, only two of the seventeen 
interaction effects viere significar.S (.05 level), little more than would be «r 
pected by chance. The fact that both significant interactions emerge from scales 
that one would e:3)ect to be hi^ly correlated with one another (a2-2s£S2^£5“ 

^ Insec ure- Secure ) lends some credence to the hypothesis that there may be some 

real interaction effect here, i.e., differences among the dLasses in the way 
in which they responded to speech samples. The remaining P ratios for the inter- 
action effects are near the expected values assuming that there is no effect. 
Third, the mean square error terms are snail and highly consistent from scale to 
scale indicating high interjudge agreer.»nt iiith respect to the ratings. 

Althou^ the analyses of variance indicate large and significant differences 
o 
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Table 1 

Analysis of Variance for Seventeen Semantic Differential Scales 



Trait 

Follower-* 


(A) 


(B) 


(C) 






MS Speech Samples 
13 af 


MS Speech Samples 
X Classes 
91 df 


JIS Error 
166U df 


F (A)/ 
/(C) 


F (B)/ 
/(< 


I,eader 

Careless- 


lU.53 


2.91 


3.U 




.9h 


Careful 

£bccitable- 


832.76 


2.93 


2,1*3 




1.20 


Calm 

Unsyinpathetic- 


263.76 


2.65 


2.59 


103.,77^'HHf 


1.02 


Sympathetic 

Suhraissive*- 


16U.90 


2.1*8 


2.52 




.98 


Dominating 

Intolerant- 


76.67 


3.09 


2.1*8 


30»88^K«t 


1.2li 


Tolerant 

Hurible- 


68.51 


2.77 


2.91 




.95 


Proud 

Shy- 


53.22 

» 


2.75 


2.28 


23»37^r^ 


1.21 


Outgoing 

Mesgy-. 


S3.5U 


2.18 


1.51 




l.lA-» 


Neat 

Insecure- 


218.33 


2.52 


2.17 


100.39"'HKf 


1.16 


Secure 

Dependent- 


58.07 


3.62 


2.32 




1.56^^ 


Independent 

Impatient- 

Patient 

Uimleasant- 


1*5.53 


3.37 


2.61* 


17.2^^HHt 


1.28 


ltil*.li8 


2.13 


1.87 


77 


1.1U 


Pleasant 
Emotional - 


11*6.03 


2.13 


2.U* 


68.0te^ 


.99 


Unemotional 

Cruel- 


31.38 


2.16 


2.53 


12,38^hh^ 


.85 


Kind 

Undependable- 


128.75 


2.60 


2.08 


6l«78^HHf 


1.25 


Dependable 

Lazy- 


75.08 


2.36 


2.15 


3U*88^HHt 


1.09 


Bnergotic 

^ - <.05 
» <.01 
• <.001 


75.1*0 


3.08 


2.78 


27»0P-5HH(- 


1.11 
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among the speech sai.gples for all of the s<3ales, the question reiiiains as to what 

# 

accounts for these differences, whether it is differences among the different 
voices used or whether there are differences among the various sub-samples of 
the same voice. This question can be answered by turning to the mean ratings of 
the i^eech sarples. As one mi^t expect, both kinds of differences exist, i.e*, 
there are differences among the different voices used in ihe recordings and there 
are differences, even more striking, among the sub-san^^les of the same *^ice. 

Figure 1 presents grsphical3y the relationship among the four speech con- 
ditions when averages are taken over all speech sarnies in the same speech con- 
dition*^ It is quite apparent i^at the ’*normal*’ and ’’fast” conditions seem to 
be rated similarly and that the "shout" and "soft" ratings follow the same 
general pattern. Further, the "normal-fast" ratings tend to follow a pattern 
which is the mirror image of the "shout-soft" ratings. The "fast" ratings tend 
to be slightly more extreme than the "nonnal", and, to a lesser degree, 
the "soft" ratin^;s are sli{^tly more deviant than the "shout", so that the 
greatest contrast is provided, generally, between tlie "fast" and the "soft"* 

It should be pointed out that the ratings of the voices, i.e., individuals, show 
t)i 9 same patterns as the mean ratings across Individuals. This can be verified 
by an examination of Tables A-Q. 

One could perform a multitude of t tests for ftie differences which exist 
among the speech samples on the various scales. The magnitudes of the relevant 
differences are so l<r ge and the standajpd errors so small and consistent from 
scale to scale (SE range from . 15 ’ to *21) that it is unnecessary to perform such 
tests in most instances. very few exceptions the differences which exist 

between the "normal-fast" on the one hand and "shout-soft" on the other are 
significant, by the usual standards, both for Individuals as well as across 
individuals. Although there are significant differences between these conditions 
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follower 
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Figure 1 



Mean Semantic Differential Ratings of Five Voices Recorded Under Four Sj>eech 
Conditions, Normal Voices). Fast, Shout, Soft 

(3 Voices Each) a 
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i,e, between “normal” and “fast” and between “shout” and “soft”^ the magnitude 

of these differences is much smaller and Figure 1 can be thought of as being 

# 

representative of the pattern of means for the individual voices as well as a 
group average. As one might expect, there are significant differences among 
the different voices speaking under the same condition^ but on the whole, with 
exception of the two voice samples which were included to disguise the task, 
speech samples under the same Conditions were rated very similarly. 

Discussion 

From the data ^^^esented, there can be little doubt that changes in “verbal 

stereotypes” can be brought about through simple (or perhaps coirqjlex) manipulation 

of the speech sables which Ss hear. In spite of the lack of control over the 

manipulation of the speech samples, similar manipulations appear to achieve the 

same effect acr(?ss different voices. Further, the evidence-( variances) Indicates 

that there is good agreement among the judges with respect to both the basic 

evaluation of the rated traits and the systematic changes in ratings brou^t 

« 

about through manipulation of the voice. 

If one accepts the “normal” conditions of these voices as the “target” 

^ * 

against which tc compare the changes brou^t about by manipulation, then one 

would have to conclude that the voices selected were not neutral with respect 

to all of the traits being rated. Rather the “normal” vojee can be. claaracterized 

• • . * • • 

as excitable , emotional, insecure, undependable , outgoing, humble, and careful . 

The “fast" condition seems to merely accentuate the ratings made on the “normal” 
condition so that the ratings of the “fast” condition on the above traits 
are sli^tly more extreme on all but two traits, insecure and emotional . Vith 
the exception of the “fast” condition being perceived as being significantly 
more impatient, the mean ratings of the “normal” and “fast” samples are 
vexy similar on all seventeen traits. 
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The “shouting” and “soft”, speech sarples, on the other hand, can be 
characterized as careless, messy 5 intolerant^ cruel > ca^, patient, gympathet^, 
and emotional . As with the “nomal" and the “fast” conditions, the mean ratings 
for “shout” and “soft” conditions tend to be very similar with the ratings of 
the “soft” samples being generally more e::treme than the ratings of the “shout" 

samples, ?y and large, the first subset of conditions, “normal" and “fast”, 

% 

tended to produce ratings that were uri.rror images (about the neutral positions) 
of the ratings of the second subset, “shout" and “soft”. 

On four scales, leader-followei^ dependent -independent j secige^^insecure , 

^JTF T 

emotional-unenotional, the resulting differences were small and, on the latter 
three scales, inconsistent. Only the leader-folloi^er scale produced differences 
tlBt were consistent from voice to voice, and in the same pattern as on the 
scales previously discussed. The significant F ratios on the latter three scales 
may be attributed to variation among the speech savples with no consistent 
pattern of ratings, in terms of manipulation, emerging, 

Atteiipting to account for the differences between condidions which emerge 

t 

in this study is very difficult inasmuch as the changes in the speech characterise. 

tics that result from the voice manipulations are complex, and it is difficult 

(if not iTiqpossible) to isolate the variables which are involved. Further, with 

the ecrception of studies by Ochiai and Fukumura (1953 j 1956) and McGee ( 196 I), 

« 

both of which investigated the effects of frequency distortion on perceptual 
quality, there are no studies even to point out possible relevant variables, 

a 

Frequency distortion (by band pass elimination) seems to result in changes in two 

dimensions of perceputal quality, a naturalness factor wiiicsh is largely dependent 

• « 

upon the presence or absence of the fundawental frequen(y of the voice and an 
anticipation quality (or intelligibility factor). Neither of these factors seem 
particularly relevant for this study. 
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An attempted analysis of differences between manipul^’.tions by means of a 
sound spectrograph proved fruitless* Variations in spectrograms for one speaker 
repeating the sane sequence of sounds and the difficulty in visually interpreting 
spectrograms combine to make generalizations virtually impossible# 

It would appear that this study effectively demonstrates that people, trhen 
asked to do so, make judgments about personality traits from the vocal character- 
istics of voices. These judgoients appear to be hi^y consistent from person 
to person, at least for the traits measured here. Further, these judg*ients can 
be systematically shifted in one direction or another by changing the physical 
characteristics of the voice sar-ple# Vhab remains to be accomplished is the 
isolation of the ^ecific variables which would account for the shifts in per- 
ceived personality characteristics. Two possible approaches to this problem 
are readily apparent. First, one might have the present speech samples rated in 
terms of vocal qualities and then correlate these ratings irith the judged per- 
sonality characteristics of the speech sariples. The second approach w ould be to 
repeat the study using mechanically contrblled nanipulation of the speech sasples 
where changes in ratings could be directly attributed to specific physical 
changes in the vocal characteristics. 



Summary 

This report concerns an e:qjerimental investigation of perceived changes in 
personality characteristics ascribed to voices as a function of manipulations 

of vocal characteristics. The stimuli (lU speech samples) consisted of a 307 

• * 

word passage read four timesj in a “normal” manner, “fast”, “shouting”’, and 
“soft", by three male readers plus the same passage read once each, in a "noiml” 
voice, two additional readers# The latter two speech samples were included 
to help disguise the nature of the e 2 q)eriment. The stimuli, after adjustments 
had been made to equate the speech samples in terms of loudness, were presented 
c 
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to the judges (hi^ school students) in a random order over a public address 
system* Perceived personality characteristics were measured lyy means of 
seventeen semantic differential rating scales. 

Consistent differences emerged between two subsets of the speech conditions 
The "normal” and "fast" conditions of each reader were rated similarly and the 
"shout" and "soft" conditions received like ratings di ff ering from tthe first 
subset on e.''.ch of the seventeen rating scales. In general, the two subsets of 
voice conditions present mirror image semantic profiles about the neutral 
position. The "fast-normal" voices were perceived as belonging to individuals 
who were careful^ insecure, humble, excitable , emotional, undependable, lazy , 
and outgoing . The "shout-soft" voices were judged to belCi^ to people who 
were careless , messy , emotional , intolerant, unpleasant, cmel, calro^i , patient 
and sympathetic . The differences between subsets on most of these scales were 
significant. 

Due to lack of previous research in this area and because of tJie general, 
nature of the manipulations ituide in the speech samples, it is not possible t© 
specify which Speech variables account for the shifts in semantic differential 
ratings. 
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Table 

Mear» Ratines for Leader-Follower 



Conditions 



Voices 

2 3 U 



5 * iOver Voices 



"Nornal” 


1».03 lt.07 it.UO li.la i*Ji9 


U.28 


»Fast«» 


U.30 lt.6l 1(.03 


lt.31 


’•Shout" 


3.61 3.92 3.72 


3.75 


"Soft" 


3.68 3.83 3.79 


3.77 


Over 

Conditions 


li.03 1».07 It.OO li.l9 1*.01 


li .06 




Table A 






Standard Deviation of Ratings 
for Iieader-Follower 




Conditions 


Voices 

1 2 3 5 


!)ver Voices 


"Normal" 


2.07 1.76 1.57 1.77 1.71 


1.79 


"Past" 


1.61 1.79 1.72 


1.73 


"Shout" 


1.85 1.66 1.90 


1.82 


"Soft" 


2.06 1.77 2.11 


2.00 


Over 

Conditions 


2.07 1.76 1.82 1.78 1.89 


1.82 
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Table Bi 

JU 

Mean Ratings for Careless-Careful 



Conditions 


Voices 

1 2 3 It S 


Over Voices 


“Normal" 


1.57 3.83 3.51* 2.29 2.53 


3.35 


"Fast" 


2.51* 2.07 3.91 


2.8 U 


"Shout" 


6.19 1*.?6 li .39 


5.18 


"Soft" 


l *.55 l *.5 l 6.07 


5.oli 


Over 

Conditions 


1.57 3.83 iu21 3. U 5 h.23 


1*.00 


Conditions 


Table Bg 

Standard Deviation of Ratings 
for Careless-Careful 

Voices 

1 2 3 1* 5 


Over Voices 


"Normal" 


1.77 1.90 1.9 l * 1.38 1.29 


1.68 


"Fast" 


1.1*1* 1.39 1.80 


1.56 


"Shout" 


1.02 1.63 1.81* 


1.52 


"Soft" 


1.72 1.75 1.38 


1.61* 


Over 

Conditions 


1.77 1.90 1.55 1.56 1.60 


1.62 
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Conditions 


Table 

Mean Ratings for Ebccitable-Calm 
Voices 

1 2 3 u 5 1 


Over Voices 


"Nonnal” 


ttaU 8 It . 30 U .56 6.11 3 . 3 ^ 


5.00 


«Fasb« 


5.67 6.01 U.52 


5.110 


«‘Shout« 


1.77 3.32 3 . 51 t 


2.88 


••Soft” * 


3.11 3 .U 5 1.93 


2.83 


Over 

Conditions 


lt.U 6 I1.30 3.78 U.72 3.88 


U.I6 



Table G2 



Standard Deviation of Ratings’ 
for Excitable- Calm 



Conditions 


1 2 3 U 5 


Over Voices 


••Normal^^ 


2.0I1 2'.18 1.92 1 .U 5 1.51 


1.8U 


”Fast«^ 


1 .U 7 1.22 1 . 7 U 


1.50 


••Shout*’ 


1.08 1.66 1.65 


1.U8 


’’Soft” 


1.73 1.58 I.U9 


1.62 


Over 

Conditions 


2.0I1 2.18 1.57 1.50 1.60 


1.62 
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Table 

Mean Ratings for Unsympathetic-Sympathetic 



Conditions 


Voices 

1 2 3 h 5 


Over Voices 


"Normal” 


2.72 ii.81* h .96 5.13 U .70 


1».38 


"Fast" 


5.32 5.09 U .08 


h.63 


"Shout" 


3.86 3.88 2.7i^ 


3.U9 


"Soft" 


2.18 3.3U 2.95 


2.82 


Over 






Conditions 


2.72 lt.8i* lt.08 lt.36 3.62 


3.95 



Table Dg 

Standard Deviation of Ratings 
for Unsympathetic-Sympathetic 



Conditions 


1 2 3 u 5 


Over Voices 


"Normal" 


I.I 16 1.79 1.77 1.80 1.51 


1.67 


"Fast" 


1.60 1.51 1.70 


1.60 


"Shout" 


1.8U 1.59 1.30 


1.58 


"Soft" 


1.U3 1,61 1.79 


1,61 


Over 


1 




Conditions 


l.lt6 1.79 1.66 1.63 1.58 1 


1 1.62 
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Table 

Mean Ratings for Submissive-Dominating 



Conditions 


1 2 3 It ? 


Over Voices 


"Normal” 


U.21 h.ca 3.33 2.77 3.02 


3.U6 


"Fast”' 


3.23 2.91 3.7tt 


3.30 


"Shout” 


CM 

CO 

• 

• 

CO 

• 


lt.62 


"Soft" 


h.31 1(.09 U.lt3 


ti.28 


Over 






Conditions 


l».21 li.Ol 1(.09 3.38 3.76 


3.83 



Table Bg 

Standard Deviation of Ratings 
For Submissive-Dominating 

Voices 



Conditions 


1 2 3 U 3 


Over Voices 


"Normal" 


1.73 1.73 1.63 1.39 1.38 


1.66 


"Fast" 


1.71 1.38 1.39 


1.63 


"Shout” 


1,31 1.53 1.63 


1.36 


"Soft" 


1.73 1.72 1.78 


1.7lt 


Over 






Conditions 


1.73 1.73 1.63 1.61 1.63 


1.63 



/PPZNDIX 



A 

- 21 - 

Table 

Mean Ratings for Intolerant-Tolerant 



Conditions 


Voices 

1 2 3 li 5 


Over Voices 


••Normal’* 


3.5h 3.95 U.Ol 3.22 3.31 


3.60 


••Fast" 


3.22 3.33 3.68 


3.U 


"Shout’» 


3.36 1*.1»9 1».03 


1i.63 


"Soft" 


h.69 lt.38 5.18 


U.75 


Over 






Conditions 


3.51t 3.95 U.32 3.86 ti.05 


U.03 







Table 






• 


Standard Deviation of .Ratings 
for Intolerant-Tolerant 




Conditions 


1 


Voices 

2 3 ll 


5 


Over Voices 


"Normal" 


1.79 


2.05 1.87 1.85 


1.70 


1.85 


"Fast" 




1.76 1.80 


1.53 


1.70 


"Shout" 




1.91 1.56 


1.51 


1.66 


••Soft" 




1.68 1.61i 


1.97 


1.76 


Over 

Conditions 


1.79 


2.05 1.81 1.71 


1.68 


1.76 









APPENDIX A 

- 22 » 



Table C5^ 

Mean Ratings for Kumbie-Froad 



Conditions 


Voices 

1 2 3 It 5 


Over Voices 


"Nomal” 


U>itl 3<6o ti.9lt $«18 U.88 


. lt.80 


"Fast" 


li.65 lt.90 li.59 


U.71 


"Shout" 


3.09 3.88 lt.56 


3.8U 


"Soft" 


li.29 3.79 3.57 


3.89 


Over 






Conditions 


UeUl 3 . 6 o k»2k 


U.3X 



Conditions 


Table 

Standard Deviation of Ratings 
For Humble -Proud 

Voices 

1 2 3 It 5 


Over Voices 


"formal” 


1.75 1.77 1.69 1 . 6 o 1.5U 


1.67 


"Fast" 


1.67 1.71 1.51 


1.63 


"Shout" 


1.62 1.53 1.69 


1.61 


"Soft'i 


1.69 1.71 1.71 


1.70 


Over' 

Conditions 


1.75 1.77 1.67 1.61t 1.6l 


1.66 



append \X A 

-2U- 



Table 

Mean Eatings for Messy-Neat 
Voices 



Conditions 


1 2 3 h 5 


Over Voices 


••Normal" 


$. 31 * 3.59 2.95 2.68 2.99 


3.51 


••Fast" 


2.50 2.U5 U.03 


2.99 


»»Shoat^‘ 


5.0l» li.58 5.2l» 


lt.95 


"Soft" 


5.92 5.03 5.73 


5.56 


Over 






Conditions 


5.3U 3.59 U.10 3.68 l».5o 


lt.l5 



Table Ig 

Standard DeTiation of Ratings 



For Messy-Neat 
Voices 



Conditions 


1 2 3 U 5 


Over Voices 


••Normal" 


1.56 1.86 1.58 1.58 1.U9 


1.61 


••Past" 


l.li6 1.31 1.1(8 


1.1(2 


••Shout^* 


1.91 1.U9 1.39 


1.60 


••Soft" 


1.09 1.1(2 1.62 


1.38 


Over 






Conditions 


1.56 1.86 1.51 1.U5 1.50 


1.52 
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Table 



Mean Ratings for Dependent-Independent 

Voices 



Conditions 


1 2 3 U 5 


Over Voices 


‘•Noitnal" 


2.76 k.i6 3.96 3.53 3.Tl( 


3.69 


“Fast*' 


iu2X 3.6U 3.90 


3.92 


“Shout" 


lt.67 U.05 2.86 


3.86 


“Soft*' 


2.85 3.65 3.7lt 


3.1tX 


Over 






Conditions 


2.76 U.l(5 3.92 3.72 3.56 


3.71 



Table K, 



Standard Deviation of Ratings 
For Dependent-Independent 



Conditions 


Voices , 

1 2 J U 5^ . 


Over Voices 


"Nomal" 


1.66 1.7U 1.68 1.88 1.83 


1.76 


"Past" 


1.66 1.76 1.63 


1.68 


"Shout" 


1.99 1.66 1.1(7 


1.71 


"Soft" 


1.71 1.66 1.97 

- - 


1.78 




Over 






Conditions 


1.66 1.7U 1.76 1.7l( 1.73 


1.7U 



i>wn ■ .i. ,. 
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Table 

Mean Ratings for Bipatient-Patient 



Conditions 


1 


Voices 

2 3 It 5 


Over Voices 


"Hormal” 


2,32 


lu77 3.1»2 1(.05 h.Z9 


3.77 


«Past« 




lt.67 lt.59 li.05 


U.bb 


’’Shout”' 




2.37 3.2it 2.60 


2.7ii 


"Soft” 




2.21 2.9U 1.7U 


2.30 


Over 

Conditions 


2.32 


U.77 3.18 3.71 3.17 


3.38 






Table 






Standard Deviation of Ratings 
For Impatient-Patient 




Conditions 


1 


Voices 

2 3 It 5 


Over Voices 


"Momal" 


1.33 


l.T!2 1.1a 1.1*3 1.36 


1.1*5 


"Fast” 




1.50 1.1(3 1.5? 


1.1*9 


"Shout" 




1.57 1.52 1.36 


1.1*8 


"Soft” 




1.33 1.37 1.17 


1.29 


Over 

Conditions 


1.33 


1.72 1.1*5 1.1*1* 1.36 


1.1*3 
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Table Mt 



Mean Ratings for Unpleasant-Pleasant 



Conditions 


Voices 

1 2 3 U 5 


Over Voices 


••Normal” 


5.21 3.81( 3.18 3.11 3.27 


3.72 


•»Fast»‘ 


2.68 3.1U 3.90 


3.2U 


••Shoat*’ 


5.11 ii.72 5.22t 


5.02 


••Soft” 


5.76 lt.83 5.30 


5.30 


Over 






Conditions 


5.21 3.8Ht 1.18 3.95 h.hi 
• 

Table Hg 

Standard Deviation of Ratings 
For Unpleasant-Pleasant 

Voices 


li.2ll 


Conditions 


1 2 3 U 5 


Over VoicM 


••Nor?nal‘» 


l.U0 1.67 1.62 1.7li 1.66 


1.62 


••Fa:.t« 


1.57 1.65 1.3l( 


1.52 


••Shout” 


1.57 1.33 1.36 


1.1(2 


••Soft” 


1.32 1.53 l.Ut 


1.1(3 


Over 






Conditions 


l.ljO 1.67 1.52 1.56 l.li5 


1.52 
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Table 

Mean Eatings for Ehotional -Unemotional 

Voices 



Conditions 


1 2 3 k 5 


lover Voices 


’•Normal” 


5.60 k.l7 k.85 S.lJt 5.07 


5.03 


’’Fast” 


U.63 5.20 k.li7 


k.77 


’•Shout” 


3.97 k.37 5.0k 


k.k6 


’’Soft” 


5.U k.52 k.53 


k.72 


Over 






Conditions i 


5.6o k.l7 k.6k k.88 k.78 

» 


k.78 



Table 

Standard deviation of Ratings 
For EhotionalrUnemotional 

Voices 



Conditions 


1 2 3 k 5 


Over Voices 


.“Normal” 


1.51 1.71 1.71 l.k8 1.5k 


1.59 


’•Fast” 


1.72 1.68 1.50 


1.63 


’•Shout.” 


2.01 1.51 1.75 


1.76 


’’Soft” 


1.79 1.63 1.73 


1.72 


Over 






Conditions 


1.51 1.71 1.81 1.58 1.63 


1«66 
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Table 0^ 

Mean Ratings for Cruel-Kind 
Voices 

1 2 3 5 


Over Voices 


’’Normal” 


5.00 3.17 3.27 3.07 3.1li 


3.53 


’’Fast” 


2.90 2.88 3.80 


3.19 


“Shout” 


U.82 1*.53 5.02 


U.79 


“Soft” 


5.1i6 li.6o 5.2l( 


5.10 

J 


Over 






Conditions 


5.00 3.17 U.ll 3.77 U.30 


1*.07 



Table Og 

Standard Deviation of Ratings 
For Cruel-Kind 



Conditions 


. Voices 

1 2 3 It 5 


Over Voices 


“Honnal” 


1.60 1.59 1.51 1.58 l.Ul 


1.5U 


“Fast” 


1.32 1.35 l.ltO 


1.36 


“Shout” 


1.73 l.lilt 1.35 


1.5l 


“Soft" 


1.33 1.53 1.61t 


l.5o 


Over 






Conditions 


1.60 1.59 1.U7 1.U8 1.U5 


l.h9 
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Table 

Mean Ratings for Undependable-Dependable 



Conditions 


Voices 

1 2 3 U 5 J 


Over Voices 


“Normal’* 


' - - 

3.62 U.lS 3.10 5.13 h.99 


U.60 


“Fast** 


lt.8U 5.58 lt.37 


U.93 


“Shoat** 


2.98 3.97 lt.07 


3.6? 


“Soft** 


3.6!^ It.l2 3.5b 


3.76 


Over 






Conditions 


3.62 li.l5 b.lb U.70 h.2k 


b.29 



Conditions 


Table P 

2 

Standard Deviation of Ratings 
For Undependable-Dependable ’ 

Voices 

1 2 3 It 5 


Over Voices 


*‘Normal*' 


1.58 1.7b 1.38 1.68 1.68 


1.61 


“Fast** 


1.51 l.b2 1.50 


l.b8 


*’Shout’* 


1.56 l.b5 1.60 


1.5b 


“Soft** 


1.66 1.59 1.5b 


1.60 


Over 

Conditions 


1.58 1.7b 1.53 1.5b 1.58 


1.57 
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A Factor Analysis of Literary Style^ 

John B« Carroll 
Harvard Uhlvereity 



Part 1 (Provisional) 



The rooti of thle Btudy are to be found In four widely separated 
dleelpUnee! peychollngulatlce, atatletlcal llneulatlce, paychooetrlce, 
and llterwy crltlclam. The problon le one of atteiuptlng to determine 
oojectlwely a number of basic vaye (referred to herein as "dimensions") 

In which prose materials vary stylistically. The study is being done 
not only for Its own sate but also with the hope that It may facilitate 
later Investigations Into aspeots of personality which may function In 
the production of varying written styles. 

I am frank in saying that 1 do not consider myself an expert on 
literary style, nor even an amateur literary critic. My only plea is 
that I believe myself capable of applying to the study of literary style 
a number of technlaues which are ordinarily outside the ken (or perhaps 
^sasstb the ken) of the savant who restricts himself to purely subjective 
nodes of Interpretation. If my technlaues are not always perfectly ob- 
jective, 1 am at least concerned with the extent to which consensual agree- 
nents can be reached and with the extent to which these agreements 



with advance distribution la ooaasctlea 

AnMl losA’ S^**?**** °° 8,yle to be held at ^diana Ihilversltv in 

results of the study contain the 

I am Indebted to Msiilra BraehM^S md '^I®*«I«‘tate. 

« the project. fortSr ^ Welnfeld, research assistants 

stltutei Hep^ il. i of con- 
U. S. Office EduoatlL SAE-7151 with the 

nunlcatlon and Leadership Skills " Bsvelopment of Com- 
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aanlfest conBlstancy. Only If the reader will temporarily put aeide any 
reeervatlons he nay hare oonoeming the attempt to ^imntlfy and objectify 
eoDothlng which nay seem to him inherently unidentifiable and unobJect* 
Iflable can he come to appreciate the possible virtues of the approach 
which is being token here. 

The objective study of literary style by means of statistical analysis 
is not a completely hovel endeavor. Let me remind you of the attempts of 
Yule- (I9^h), the British statistician who doubled as a literary detective , 
to resolve the problem of the authorship of Be Imitatlo Chrieti . Or let 
me call to your attention the recent work of the french literary statistician 
Guiraud (l9^h) with his studies of the vocabularies of French poets , or the 
work of the German scholars Wilhelm Fucke (19^^> and Annemarle Schllemann 
( 19 ^^) with their mathematical studies of stylistic variations 1 or the work 
of the Britisher Eerdan (19^6) . At the same time let me point out that 
none of these scholars has ventured to ask the question which I am asking 
here: What are the basic dimensions in which style varies? Bach of them 
has seized on one or enother of the possible ways of measuring style with* 
out necessarily considering its relations to other measures. 

The approach I have taken is facilitated ty the current availability , 
at long last I of machinery for the convenient handling of large masses of 
quantitative data. The bade design is one which psychologists have long 
used In the objective study of personality and other aspects of human be* 
havior. Their procedure has been to apply a series of tests or other 
meesurement procedures to a heterogeneous sample of human personalities , 
then to analyze the basic dimensionB of personality by a statistical pro- 
cedure known as factor analysis, I propose to study in like manner the 
**pereonalitlee’' of a heterogeneous sample of literary styles. 



Appendix B « 



3 



Procedure 

The flenple 

The Buceess of a factor analysis depends partly upon the extent to 

which the underlying data represent the broadest possible range of multi - 

a 

dimenBlonal variation obtainable. For example « /factorial study of the 
personalities of the innates of a mental hospital, while feasible, would not be 
be as satisfactory as one applied to a sample of the general population. 

In the present case the problem was one of selecting a highly heterogeneous 
sample of written materials, representing a wide variety of literary and 
non-llterary styles. We did this by blocking out the design of our sas^le 
in terms of a number of categories; the actual distribution of the 150 
selections which were eventually assembled is presented in Table 1. 



Table 1 about here 

From hero the selection was made by what might be called studied 
serendipity. Two of my assistanta wore turned loose in Wldener Library 
stacks with Instructions to fulfil the specifications of the sample design; 
I did not attempt to supervise their selections in detail, but I am sat- 
isfied that the sample they selected was sufficiently varied. They did, to 
be sure, receive assietance from specialists in certain categor' of lit- 
erature. Certain restrictions were placed on the selections. First, they 
had to have been written originally in English; second, they had to have 
been written after the yeai* l800 (actually, a few were sllghtJy earlier); 
and third, they had to bo passages which were mors or loss self-contained 
in about 300 words, for that was the maximum length that we thought could 
be studied within the tioe and moans at our disposal. There was an effort 
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Type 



No. Type 



No. 



AdTsnture KarratlTe 

AdTextisenents ....... 

Aesthetic Crltleism*. 

Art .... 

Music 

Literary 

Stages cinsaa, ballet • 

Anecdote 

Biography 

Clinical Beports: 

Medical 

Feychologlcal 

Condensations ...•.••• 
Essays: 

. Literary 

Editorials ..*...• 
Features In periodicals. 
Personality sketches . . 

Philosophical 

Miscellaneous 



Fantasy 

Children’s stories . 
Science fiction . . 

Gossip colunin 

ElgL> school terthooks . . 

History 

How-to-do-it Instructions 



e 






3 

k 



3 

1 

8 

3 

1 

7 

1 

h 

2 

, 8 . 

6 

2 

3 

2 

1 

3 

1 

I 

k 

5 

5 



Humor 

Inspiration a;;d adTice 

Journalistic reporting 

Judicial decisions 

Legal dcounents 

letters 

Novels: 

19 th eentury British .... 

19 th century American . . • . 

20th eentury British .... 

20th eentury American . . • 

Personal diaries 

Popular science 

Professional and 

scholarly Journals 

Short storloB 

Social criticism 

Speeches 

Sports writing 

Travel guides 

Writing assignments (high sch ool) 

7 otal ... 150 



e e 



4=*4r 4r\JMO 0\ 4^ 4r>J» OSH U> CO 4^ 
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to ol>tain Tarlatlon even within categorlee; for examplo, within the category 
hovel a vide range of styles and periods was represented, ft'om both Britain 
and America, and here it was possible to select passages from a number of 
authors whose styles are well known as distinctive, e.g. Henzy James, 

Millim Faulkner, Thomas Hardy and John Dos Passos. At the same time, it 
must be emphasised that extreme catholicity was displayed in the selections* 
For our purposes , Mickey Spillane was quite as acceptable as Jane Austen; 
the magazine Confidential was represonted alongside a selection from the 
Christian Science Monitor . In order to insure that some ”bad” writing was 
included, we selected several low-grade hlgh-school English compositions 
for our sanq>le. 

After the passages had been selected, they were typed double-spaced 
in a uniform manner on purple duplicator masters , one to a page , in order 
to produce the number of copies which would be needed for analysis. F^ch 
selection was identified only by a code number, and the 150 selections wore 
made up into spiral-bound booklets for convenience in handling. The title 
given to this collection, "A Sub -Sub-Treasury of Literary Style" may indi- 
cate our attitude toward it. 

Measures Annlled to the Pasnaf^ea . 

The nature of our data tended to limit to some degree the kinds of 
measures which we could employ. Our samples were only a little more than 
300 words in length, each, and it was therefore not sensible to apply any* 
of the measures proposed by Guiraud (195^^) , measures which are appropriate 
only for studying the vocabulary represented by thousands of words of tev.b* 

In any case, we felt that the sort of literary style which wa were Interested 
in Investigating is the sort that would bo alreedy apparent rather clearly 
by the time a reader gets through 300 words. Another factor tending to 

er|c 
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limit the kinds of measures' ve might employ ims the time aTBllable, One 
can conoelra certain types of measinres vhleh might he highly meaningful 
hut which would take an enormous investment of time; euoh a measure « for 
ei^amplei might he the determination of the relative frequency of each 
word In seme standard iVequjnoy list such as Lorge's magazine count (1944) 
and the assignment of relative difficulty of vocahulary from the average 
frequency of the word. Any such idea had to he ruled out at the etcirt. 

The measuree actually employed were burdensome enough In themselves. 

The measms en^jloyed may he classified into two major divisions: 
the subjective i^aeures and 

/the "objective" measures. The aubJeetlve measures consisted of ratings 
of the passages on 29 7 "Point rating scales constructed after the fashion 
of those which Osgood and his associates (1957) at the Ohlvarslty of 
Illinois have used to obtain "semantic differential" measurenents of 
meaning.' These ratings were obtained fres 8 Judges , each of whom rated 
all 150 passages on the same rating form but in different orders of pre- 
sentation to counterbalance practice and fatigue effects. The 8 Judges 
were all persons with some degree of special lnte3?est and competenoe in 
the field of English literature; one of them holds a doctor’s degree la 
English literature, one is a free-lance writer, several are graduate students 
with college English majors preparing to he secondary school English teachers, 
and several are simply graduate students in education with college English 
najore but no other special qualifications. 

The rating form and the instructions to the raters are attached as 
Appendix A and Appendix B, respectively. 

The decision to confine the subjective ratings to the 29 adjectival 
scales was made in the interests of simplicity and in the hope of meeting the 
deadline Imposed by the April 1958 style conference. It was expected that 
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the averaged ratings from 8 Judges would he sufficiently static and reliable 
to yield useful neasureneuts; If statistical analysis should prove that they 
were not# this in itself would be a point of interest. 

Considerable thought was put into the selection of the scales on which 
our samples would be rated* The first four scales were more or less arbl* 
trarily chosen as dimensions of "content" rather than style* Ve were not 
actually interested in the dimensions of content# and the inclusion of these 
scales is Justified more by the hope that they would draw the rater's at* 
tention to the distinction between content and style than by any intrinsic 
Interest in these scales. The remaining 2^ scales were supposed to be 
ratings of "style" rather than content# and it is on these that we tried to 
use Judgment and discrimination. 

Several sources of ideas wesre used for selection of the adjectival 
scales for the style ratings. In the background were the findings of 
Osgood, Suci and Tannenbaum (1957) bo the effect that three main "connotative" 
dimeneioxie tend to be found for almost any sample of objects# whether they 
are seta of concept words# political figures# or what not; the dimensions 
of evaluation , activity , and notenev . It seemed reasonable that written 
communications of any sort would lend themselves to stylistic choracteriza* 
tion in terms of such adjectival scales as good -bad . active*paegiye . and 
6trongn?eak . corresponding to the thi'ee Osgoodien connotative dlmscslons . 

Of epeeial relevance was a study by W. T. Tucker# one of Osgood's students# 
reported in the MaaaureTne r.t of Meaning (1957) 

f * 

Tucker had assembled a series of ko adjectival rating scales by getting 
artists' and non-artists' free associations to color slides of paintings 
and by drawing from the free-reoponce cosnnents of \ Heitors to an arts 
restlval* Using these scales in a conventional "somantlo differential" 
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deelgn InyolTlng ratings of soyan raprasantatlonal paintings, ^oksr'a 
data ravealed nha same three factors In aesthebie Judgments that bad been 
found in studies of words* We felt that many of Tucker's scales night be 
appropriate for our purposes, and some of his scales suggested other, re* 
lated scales which could be employed. 

Another source of Ideas vas Boget's thesaurus, which happens to contain 
a section expressly devoted to words useful for characterising style. The 
five major headings employed by Boget are as follows: Perspicuity* 
Obscurity, Conel8enos8*Piffusene8B, 7igour*Feebleness, Plainness -Ornament, 
and Elegance -Inelegance* 

Prom an exanir«itlon of all the materials at hand, including Tucker's 
scales, the categories suggested by Boget's thesaurus, and an assortnent of 
miscellaneous hunches from personal experience and observation, a prelim- 
inary classification of dimensions was arrived at. This classification Is 
shown in Table 2 together with the adjectival scales classified imder each 
heading. 



Table 2 about here 



In setting up the final rating sheet, we took the precaution of putting 
the scales in a more or less random order, at the seme time being sure 
that no two adjacent scales were from the same group. Furthermore, the 
polarities of the scales were deliberately rendoalzed; that is, Insofar as 
every scale is to some extent "evaluative" the "good" or "desirable" end 
of the scale is either at the left or at the right, at random. This 
arrangement follows usual practices in the construction of rating scales 
and tends to minlmlae the so-called "halo" effect In rating. The scale 
bed -good ^ras deliberately placed at the end of the list in order to suggest 
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T&ble 2 

Claeslfloatlon of Adjectival Scales 



Aeethetic QueHiy 
6 evaoeful-avkward 
29 bad -good 
26 pleasant-unpleasant 
11 uncouth-elegant 

Cpnanunioatlvenefla 
5 Bucclnct-wordy 
18 chaotic -ordered 

13 clear-hazy 
21 vague-precise 

Variety 

28 florid -plain 
8 austere -lush 

14 InteroBtlng-borlng 
2^ complez-slmple 

17 orlglnal-trlte 
23 monotonous -varied 



Vigor 

19 vlvld-pale 

7 placid -vigorous 
22 masculine -femlne 
1^ veak-etrong 

Humor 

27 serious -humorous 
9 flippant-earnest 

P ersonal Anneal 
10 IntlE'Ate-remote 

20 Isg^orsonal-personal 
12 natural-affected 

Affective Tone 
16 impartial-opinionated 
2k emotional-rational 
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that ve vlshed an ororaU eyaluaiion of the paaeage at that point. 

Tahla 2 is in affect a aet of hjpotheaea about aoaia of the dliaenolone 
of literary atyle. The prlnary purpoae of evolving theae hypotheaea vaa 
to make it more prohahle that ve had covered aU the elgnlflcent dlmenalona 
of characterization in our rating scale. Furthermore, heoauae of the re- 
Vilrementa of the atatletieal technlgue of factor analyaie vhlch va were to 
employ, it waa neoeaeary to assure eureolvea that each poaelhle dlmeriaion 
vaa "overdetermlned," that is, repreaented by at least two scales. Aside 
frcm the fact that scmiA o£ the ocales are almoat exact aemantic dupllcatea 
of one another, there la nothing in Table 2 which predetermines the outcome 

of the analysis e 

For ©stahllBhing oh.leetive measures of style, we sought ideas and 
suggestions from a numhor of sources a In the first place, our worh could 
he regarded as in the tradition of Buseiaann’s (1925) and Boder’s (19^) 
studios of the adjective-^erh quotients There Is evidonce, however, to 
suggest that the taking of a ratio between verb and adjective frequencies 
may hi^.e significant variation, and that therefore It would be wiser to 
obtain separate measures cf verb and adjective Incidence, with the possibility 
of taking ratios at a later stage. As a matter of fact it was decided to 
a rather oonqprehenslve series or counts of most cf the conventional 
parts of speech. Our decisions in this area were aided by consideration 
of the results of a recent doctoral dissertation by S. E* Milder (1957) i 
studied the correlations between intidences of 13 grajssratlcal categories 
In a sample of compostlons written in a college fi-eshman English course. 

He found that the incidence of pronouns and verbs was inversely related to 
that of nouns and. articles; the occurrence of adjectives was largely Inde* 
pendent of that of any other prut of spoooh. Our own counts of parts of 
speech were based on a semewhat finer class! float iosx than was Miller *oj 
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for ezamplai ve distineuielied ^between daccrlptlye and detemilnlng adjeotlves 
and Batwaan rarioua Idnds of pronouns* 

Ona of tha most a 2 CtenslTa stadias of spoaeh and parsonality variablas^ 
which utilized a large number of "psyehegranaatical" categorias, was made 
by Sanford (19^2) soma years ago. Sanford want considerably beyond tha 
mere counting of parte of speech; ha oonstruotad naasuras of sentence 
Btsnictura, used a large number of refined gremnatlcal categories , and even 
counted figures of speech and stylistic devices. A considerable number of 
our measures were derived from^ or adapted from, measures used by Sanford. 

It was necessary I however, to select only measures for which we believed 
there would be sufficient variation manifested in BOO-^word samples to make 
counting worthwhile. 

One other source of suggestioos for measures which might be employed 
in studying prose style was the considerable literature (Chall, 19^) on 
various aspects of '‘readability” or style difficulty. Readability has 
been shown to be related to the extent to which readers of various degrees 
of education can comprehend Witten material. There are probably several 
dimensions of readability but this problem has never been adequately studied. 
Flesch (19^9 I 19^0) has proposed measures of "Readability Level,” "Human 
Interest," and "Level of Abstraction." These measures depend upon simple 
counts of such things as the number of syllables per 100 words, the number 
of personal pronouns, and the like. OiUle (19^7) has attempted to slm* 
pllfy Flesch 'e proced\u?e for measuring abstraction. A number of the measures 
used in this study are taken directly or adapted from procedures developed 
by Flo*»oh, Gillie, and others. 

Trble 3 presents the complete list of objecti've measures used in this 
study and for vhloh results are reported in the second part of this paper. 

We do not have any partirulai* IjypotnaneB oonoeming the manner in which 



Tal)le 3 



List of Objective Measures of Style 
{All measures are In terms of 30 O-word samples) 



Number Description 



101 Nimber of paragraphs 

102 Number of syllables 

103 Number of sentences 

lOk Standard deviation of sentence length 



120 

121 

122 

123 

124 

125 



Number of clauses (independent and dependent); eauals uunbex* of finite 
verbs. 

Clause complexity Index 

Proportion of noun clauses to all dependent clauses 

” ” adjectival " ” " " ” 

” '' adverbial " *’ " " *" 

” " parenthetical” " " " 

(Measures l4o-l48 refer only to finite verbs) 
l4o Piraportlon of “action” verbs to total verbs less copulas. 

“ ’'cognitive' 

transitive 
intransitive” 
copulas to total verbs 

latln-Oreek derivative verbs to total verbs loss, copulas . 
passive verbs to all transitive 
past to future. 



..It 



141 
14S 

143 

144 

145 

146 

147 "Mean tsnee" 



If 

II 

M 

• 

II 

II 



.tt ft 
II 



" transitive verbs. 
” total verbs 



II 



If 



If 



148 Entropy of tense distribution 



149 Total number of Infinitives 

150 Total number of pEartlciplea 

151 Total number of gerunds 

. • ^ 

160 Total number of proper nouns or proper noun phrases 

1 6 1 Total number of cononon nouns 

162 Proportion of unmodified cosanon nouns preceded by the 

163 Proportion of common nouns ending in Gillie '0 suffixes 

(-ness, -ment, -ship, -dom, -nee, -lai, -y except diminutives) 

164 Propoi^lon of common nouns having Latin Greek etymology 



170 Number of artlcloe (a, the ) 

171 Proportion of indefinite article a to all articiee 

172 Number of personal pronouns and reflexive pronouns (excluding possesslves) 

173 Number of possessive pronouns 

174 Number of indefinite prenouns 

175 Number of indefinite and q,uantlfying determiners 

176 Noiiber of demonstrative pronouns 

177 Nurierioal expressions 

178 Number of prepositions 

180 Number of non-partlclplal descriptive adjectives 

181 N^rsber of participial modifiers preceding a noun 

182 Proportion of desorlptlvo adjectives wltij Latin-Greefc etymology 
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these neaeuree will tend to cluster In the correlational analysis* It 
Is our ikipe, at any rate, that nany of these measures vlll shov slgnlfl* 
cant relatlonshjps to the suh^eotlve measures discussed earlier* 

Whererer feasible, these measures are being obtained separately on 
the first and second halres of the 300-vord sangple^; In this vay It nay bo 
possible to nahe some estimates of the charaoterlstlo stability of the 
measures* 

Part II will contain the following tables and Interpretations thereof 

a* Bellablllty values for the subjective ratings 

b* Bellablllty values for the objective measures 

c. Intercorrelations of all the measures based on 

the 1^0 passages studied 

d. Botated factor matrix giving the loadings of each measure on 

each factor 

e. Factor score profiles for selected passages to Illustrate the 

applicability of the prooedure to the indexing of literary 

style. 



•• 
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A Factor Analysis of Literary Style 

John B. Carroll 
Eavard Unlrerslty 

Part 2 

BESuLuB GF StAtISxICAL AsALxSES 
at Batinga 

Eoff much did the ’Judf^es agree In their ratlnge of the 1^0 passages on 
the 29 scales? A statistical answer to this q^uestlon Is proTidod by the 
coefficient of reliability « a special application of the aeasnre of corre" 
latlon loiown as the Pearsonlan produot*^oment correlation coefficient* A 
coefficient of 1.00 would denote perfect agreexoent, and one of .00 would 
denote completely random agreements Table 4 presents the reliability oo* 
efficients obtained for the areraged ratings made by the eight .fudges; each 
value may be interpreted as the estimated corxeilation which would be ob* 
talned between the present set of ratings and a second^ eq,ulvalent set of 
ratlnge from eight other Judges • The reliabilities range from *64l| for 
the scale xaak^atiam, to *9l6| for the scale hmcoroiifl^eftrloufli with a median 
at *803* They are high enoughi in every oassi to suggest that the averaged 
ratings are sufficiently reliable for use In further analysis* The lack of 
perfect agreement among the Judges can be ascribed to a number of sources* 

The measurement technician will recognize that some of the unreliability Is 
due to random fluctuations In the use of a numerical scale: the ratings of 
even a single Judge made on several different occasions would not agree 
perfectly* More importantly > unreliability Is due to different basos of 
Judgment on the part of the various raters, and probably also to different 
degrees of appropriateness of the adjectl'val scales. The scales nflanlaglsafl* 
and have reliabilities as low as *69 because, we 
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Means. Standard Beylatlons and Bellabilltlas of Areraged Batlagii 

of 1^0 Paasages nada bgr 6 Batara 



SoaXa . 

(1) M (T) 

(COMTBNT) 

1. snperfieial - profound 

2. obYloua - aubtle 

3. oonorata ** abstraot 
neanlnglass - meaningful 




a t > 






3# 91 
3.33 
3.20 
$.20 



«i#OI»V# 

1.29 

l.6o 

1.01 



,Ak1 

m ww 

.806 

.895 

.696 



(ST^) 



5. 


wordy 


succinct 


6. 


awkward 


graceful 


7. 


plaold 


vigorous 


8. 


austere 


lush 


9. 


flippant • earnest 


10. 


remote 


intimate 


11. 


uncouth 


elegant 


12. 


affected 


natural 


13. 


hasy 


clear 


Ih. 


boring 


intereatlng 


15. 


weak 


atrong 


16. 


impartial 


opinionated 


17. 


trite 


original 


18. 


chaotio 


ordered 


19. 


pale 


vivid 


20. 


imperaonal 


perscaal 


21. 


vasue 


preclee 


22. 


f3mi)ix)’ie 


uasovuMne 


23. 


monotonous 


varied 


2h. 


ratloisal 


emutional 


25. 


cinp.le 


eoiiplox 


26. 


unpleaoarit 


pleasant 


27. 


humorous 


aorlr.us 


28. 


pl^ln 


florid 


29. 


bad 


good 



^.39 


1.21 


.775 


>>.31 


1.03 


.730 


4.60 


1.08 


.802 


)>.03 


.94 


.803 


5.33 


1.24 


.872 


4.20 


1.31 


.869 


4.09 


.83 


.823 


4.34 


1.21 


.8o4 


5.46 


1.17 


.776 


4.90 


1.19 


.777 


4.60 


.91 


.641 


4.54 


1.37 


.888 


4.34 


1.08 


.788 


4.87 


1.00 


,890 


5.03 


1.07 


.795 


4.21 


1.4o 


.858 


i 5.00 


1.04 


.708 


4.6r 


1.17 


.850 


4.U 


1.12 


.749 


4.03 


1.45 


.898 


3.92 


1.21 


.822 


4., 56 


1.09 


.748 


5.58 


1>31 


.918 


4.05 


1.07 


.820 


4.48 


1.07 


.738 



a Bellabllltles were detemlaad by the teohniq,ue preaanted by Robert 
Ebel, Poyoho t&etrlka. 1951> l6, 407-*<2h. Tboy are the eatlnatad rellabll' 
Itlea of the^?inal av eraged ratlngaf the reliability of the ratlnga 
aaalgced by a nlngle Judge cou.Xd be estimated, if dealz^d, by stepping 
down" the former value by the Speaxman-Broifn prbphooy formula. 
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nay guese, Judgas dlffai* In thalr coneeptlons of how theea terse apply to 
prose pasB^esi and the scale Hsah*£tSfiag has a rellahlllty of only .64 because,: 
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phorloal extension* On the other hand, it is useful to know that judges can 
agree well In applying adjectives lihe aacloua^ ahfitrofit^ enolilflsal, J3pin* 
lQnfttfld» AOKoafit, ip.tlnaftte» pamonal^ csaculina^ and jaesSsml* 

Table 4 also shows the means and standard deviations of the averaged 
ratings* These results are gratifying because they indicate that the 1^0 
prose passages which were selected for study are highly beterogeneo\is, covering 
nearly the whole spectrum of variation on each of the 29 scales* The nflaa 
avearsged ratings, however, tend to lie toward the more "favorable” ends of 
the scales* That is, on the average the passages were judged to be more 
aa^alagful than naanlwalftBa, more euoelnet than wordy ,, more graceful than 
aaksiPgd^ more eameat than flinnant f etc* This finding probably reflects the 
fact that the passages were on the whole taken from sources from which one can 
expect good writing* On the other hand, the results indicate that the passages 
were on the average judged more eunerfioial than profound s more obvloue than 
ffljfttlPi more concrete than ebetraot . and more simple than complex . This may 
"')fleot the fact that the pacsages were selected more from literatwe Intended 
to entertain than frcm literature Intended to instruct or to inspire. 



Charaoteristlofl of the Cbieetlve Meanuree of Style 

Means, standard deviations, and reliabilities for the objective measures 
are shown in Table The means and standard deviations are presented mainly 
for their usefulness as parameters by which one can compare the present sample 
with others; however, because of the oare taloen in choosing the present eampla, 
these valuaa may probably be regarded as close to the values which would be 
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TABLE 3 



Means ^ Stendax^ Beyiatious ^ Ballul^illi/idSy oud 



ji xji /%.2\ 

~.uxa0 



of the O'bJecblYe Measures cf Style 
(All neasures are for 300'%rcrd sanplea) 



Maftflura 

Nusiber of paragraphs started 
Number of syllables 
Number of sentences started 
Standard deviation of sentence 
length 

Number of clauses (both 
independent and dependent) 

Clause oonplezlty index 
Proportion of noun clauses 
Proportion of ad^'eotlvel*. clauses 
Proportion of adverbial clauses 
Proportion of paronthetioal clauses 

Proportion of "action” verbs 
Proportion of ''cognitive” verbs 
Proportion of transitive verbs 
Proportion of intransitive verbs 
Proportion cf copulas 

Propoirblon of Latin-derived verbs 
Proportion of passive verbs 
"Mean tense" (l » Paotj 3 “ Future) 
Entropy of tense distribution 
Number of infinltivea 

NuiELber of participles 
Number of gerunds 
Number of proper nouns 
Number of common nouns 
Proportion of unmodified oomon 
nouns preceded by 

Proportion of nouns ending in 
GlUle*a suffixes 
Number of articles 
Proportion of indefinite articles 
Number of personal and reflexive 
pronouns 

Number of possessive pronouns 



Meen 


ZSl.* 




...Jdoa.ai 


1^.00 


2.75 * 


.38 


2 


^51.85 


45.57 .860 


.73 


m 




5.85 .850 




2 


X4.15 


11.44 .166 


.37 


0 


30.97 


8.65 .m 


.81 


- 


8.30 


3.45 .6c5 


.33 




.268 


.201 - 


.38 


3 


.33>> 


.198 ■ 


•28 


3 


.339 


.189 - 


•Ih 


3 


.oi»9 


.092 - 


.09 


3 


.335 


.227 .762 


•60 


3 


.157 


.142 .575 


.30 


3 


.583 


.126 .331 


.50 


3 


.122 


.083 .26 


.25 


3 


.283 


.114 .44 


.31 


3 


.355 


.250 .57 


.33 


3 


.186 


.175 .49 


.4f> 


3 


1.58 


.33 .88 


.27 


- 


Ml 


.260 .42 


•13 


- 


4,23 


2.73 - 


•20 


2 


3.27 


3.01 


.21 


2 


2.24 


2,f.3 


•20 


2 


8.31 


8.a .83 


.39 


2 


63.89 


12.56 .74 


.50 


• 


.080 


.068 .45 


•42 


3 


.185 


.105 .69 


•^4 


3 


27.69 


7.39 .52 


.34 


• 


.287 


.133 .48 


•28 


3 


16. i 6 


10.21 .64 


^83 


2 


6.19 


3>94 .64 


.3£ 


2 






Appendix B 

19a 





I&Ue ? (eont.) 








Jla. 


Mfiflfliga 


Uam 


S*D» 


ml* 


2 


trasafoma' 


60 


Number of indefinite pronouns 


1.57 


X .76 


.43 


.28 


a 


61 


Number of indefinite and qualifying 
determiners 


7.05 


3.50 


.27 


.33 


2 


62 


Number of demonstratiye pronouns 


3.25 


S.3>» 


.44 


.14 


2 


63 


Tumber of numerical expressions 


3.91 


4.5X 


.67 


.33 


2 


64 


Number of prepositions 


35.95 


7.28 


.58 


.40 




65 


Total number of pronouns 


24.16 


X2.90 


.83 


.87 


- 


66 


Total number of determiners 


17.64 


8.31 


.52 


.45 


2 


67 


Number of desoriptiye adjectives 


16.01 


7M 


.66 


.36 


2 


6B 


Number of participial modifiers of 
nouns 


3.11 


2.23 


.38 


.18 


2 



^Bella'bllltles were oGoputod tj "stepplsg^up” the hotveen^halves oorrelations hy 
means of the Speaxmen^Brotm prophecy formula. 

’^hese oommunalltieB are haeed on all 7 centroid factors which were extracted. 

'^Because disdimilar marginal dietrihutions isiply non*linoar relations hetwoen 
veriahles^ scores whose dlstrlhutions appeared on inspection to ho signlfl** 
oantly non**s 7 ismdtrioal wero subjected to one of the following transformations ^ 
as indicated ahore: 

2: X* « 45 log^Q (X + 1) [for log normal dlstrlhutions] 

3 s « 63.662 sin \f p [whero the scores are proportions]. 



e 
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obtained for a much larger saapl©. For example, we find that the arerage number 
of syllables for 300 worlds lo i^51.85; the resulting value of about 1 1/2 cyl- 
lablee per word may be taken as typical for seioples of written SngliBh* 

Of most Interest are the rollabllltles for the meaeijores, obtained by 
finding the cozrelatlon between measures for the first and second halves of 
the passages and estimating (by the conventional Spearman-Brown formula) the 
correlation which would exist between the values for a 300-word sample and 
another, equivalent 300-word sample. It was not always feasible to confute 
a split-half correlation, and In these cases one nay gain some isgoxesslon of 
the reliabilities by inspecting the oomaunallties computed from the factor 
analysis (to be discussed below). In theory, the reliability of a variable 
should be at least as great as Its comunality; while it nay or may not be 
considerably greater than the communality, if the conmunality approaches 
unity the reliability also must approach unity. 

On the whole, the reliabilities for the ob;)octiV0 measures of style tend 
to be considerably lower than those for tho subjective measures; they range 
from .17 to .88, with a median of .^7* This means that tho characterietlos of 
prose which we have chosen to measure tend not to be very stable from one half 
of a passage to the next half of the same passage. There are, however, 
characteristics which are quite stable, e.g., the number of syllables per 
300 words, the number of senbenoee started In 300 words, the number of clauses, 
the proportion cf "action” verbs, and the number of proper nouns, all these 
measures having rollabilitlee greater than .75* 

It Is also of Interest to study the relation between the reliabilities 
of the measures and tholr coxa&unalltles. The communality lo a coefficient 
rs^lng between .00 and 1.00 which Indicates the ’^rbont to which a varloble 
measures something in conmon with the other variablos In a given set (in this 

ERIC 

MnifflffriTLilJ 
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case, the comp3.etd eet of 68 suhJostiTe and ohjectlve measures of style). 

When the oommunality Is low, it may denote that the variable has a lovr relia- 
hllityi hut If the reliahillty is ^own to he high^ a lov^ comounality denotes 
that the variable has high "specific” variance , that is, that it measures some- 
thing which is not measured by any variabJo in the set* There are quite a 
number of variables which seem to have high spoclfic variance^ e.g. variable 
32 (number of eeatences), variable hy ("mean tense"), and variable 52 (number 
of proper nouns). Evidently those are characteristics of style which are 
highly stable and yet not much related to other measures of style. 

CjMff elat i ons Among the Sub.lacti^e u^s 

The 4o6 different Intercorrelaticns among the 29 rating scales are 
presented in Table 6» It will be noted, incidentally, that some of the scales 
have been "reflected" (l.e., the ends have been Interchanged) in order to make 
the eorrolatlons preponderantly positive. For example, in the original rating 
scale the soales for clear-haay and vague -nrec iae had opposite polarities, a 
rating of meaning jhagy in the first case and ureclee in the second. The 
correlation between the scales was originally -.06, but changing the sign to 
positive implies that the scales are to be taken w5th the same polarity. It 
was not possible, however, to make all the oorrelatlons positive by this pro- 
cedure; there seem to be some Intrinsically negative relationships, as will be 
seen more clearly from the factor analysis. 

The oorrelatlons among scales which are clearly related semantically are 
in general high, as would be ei^jected. Contrariwise, correlations between se- 
mantically unrelated scales were in general low. One would be eoncezned if 
this were not the case. On the other hand, the relationships are complex and 
cannot be predicted completely from the semantics of the terms. For example. 
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one flBlght not neoesearlly ejcpeot visgdyBuooinet and aff aetad natural to hayo a 



ccx«elaticu as high aS *62 ^os they aotuallsr did havo^ sinoo thoBO BcaleS vould 



at first gXanos seem to refer to different oharaoterlstloe. Prohably the fudges 
would he surprised to learn that their ratlnss on these scales oorrelated so 
highly • Yet, In making these ratings the Judges must have been responding to 
the same essential oharaoterlstlcs of the prose passages, whatever they may 
have been. It Is the task of the factor analysis to elucidate these essential 
characteristics; Indeed, the purpose of the factor analysis Is to provide a 
way of summarlalng the data shewn In a correlation xnatrlsea 



gorrelatlons Among the Ob.leotlve Meaauii»s 

The 7^1 different Interoorrelatlons among the objective style messures 
are shown In Table 7i partly on account of their generally lower reliabilities 
the variables tend to have somewhat lower Intercorrelations than the subjective 
measures* There are nevertheless a considerable number of significant Inter- 
oorrelatlons, certainly enough to make factor analysis appropriate, and desirable* 

Correl ations Between the Subjective and the Objective Meaaurea 

The 1131 different Intercorrelations between the eubjeetive and the ob* 
Jeotive measures arc presented in Table 8* The data merit careful study, for 
it appears that /character} stlos of prose passages which oan be rat<?d subJeotlveJy 
can also be measured objectively* This, of course, has been known feo* some 
time, for it provides the basis for the vcurlous systems for measuring ”read» 
ability” tnd "human Interest" which have been proposed by a numiber of Investl* 
gators* We believe, however, that the present data are the most extensive 
available, and that only a study like the present on<* oan approach a satisfactory 
delineation of the distinct dlmensloi^c which underlie the relationships between 
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subjeotlre and objective neaaures of style* 

Ilia Factor Ai;^ l ,yBlfl 

The 2278 different Intercorrelations among all 29 subjective and 39 
objective measures taken together were considered as constituting a single matrix 
and subjected to a multiple factor analysis by the centroid method of Thurstons 
(19^7 ) • The analysis vas performed by su9ans of a high*speed electronic com- 
puting machine; the highest correlation In each array -iras used as the initial 
estimate of communallty for the corresponding variable* After seven centroid 
factors wore extracted ^ the resldiial correlations were clearly of a nearly 
random character and it was decided to stop extracting factors* The ceven 
factors accounted for 53 *8^ of the total variance; the remaining 46*2^ is 
Judged to be mainly variance due to unreliability, in view of the fact that 
most of the communalities approach tho reliabilities fairly olosely* The re- 
sulting centroid factor matrix is presented as Table 9 (not Included in this 
provisional version of the paper) , together with communalities and data on 
the proportion of variance extracted with each factor* 

The factors were rotated to slnqple structure by the biquartlmln soluoion, 
a method developed and programmed for hlgh-spoed computing maohinea by the 
writer (1957) • Since this method is complotely analytical, it was not nec- 
essary to make any subjective Judgments in arrlvlxig at the final rotated factor 
matrix presented as Table 10 r (Before the recent introduction of analytical 
methods of rotation, factor analysis was the target of criticism to the effect 
that the concept of simple structure was not objectively defined*) 

The first four factors in Table 10 are clearly distinct and meaningful. 

Of tho last three factors, two aro nocirJy duplicates of each other (perhaps 
resulting fi^om a possible technical failure in applying the blquartlmln solution) 
and none Is clearly Interprelable, Tho first four fact-ore, however, appear to 
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TablA 10 



Rotated Factor Matrix 
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Table 10 (oont.) 
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Transfomatlon Matrix 
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•546 


.037 .049 


.145 




III .804 


* 

1 


,411 


.219 


.021 -.207 -.215 


.172 




r\T .261 


•• 

1 


,440 


’.448 


.313 


.288 .3.14 


^308 




V -.026 


1 


.448 


.350 


.226 


.246 .235 


.207 




VI ,089 


1 


,068 


.127 


-.609 


.800 .83rw 


•682 




VII .210 


« 


,200 


.683 


.277 


.407 .313 


.585 





ERIC 
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aeoount for a very large part of the ooimnon factor varianoe of all the 68 
measures p and nay he regarded as being probably the most basic and pervasive 
factors of style* Further studies nay turn up new factors, but these new factors 
will doubtless be of relatively small extent and applications* 

Perhaps It should be said at this point that the results do not siqppor^ any 

sepcuttte 

clear distinction between content and style, l*e«, /factors for content and style 
were not found, but rather, the factors out across the boundaries ordinarily 
assumed for content and style. Ve were already aware that this might be the case 
when ve received reports from our Judges that they had extreme difficulty In 
separating content from style. 

In what follows, ve will attei^pt to present the several factors of ''style" 
(or "style-content") which were isolated. As Is customary, a list of the var- 
iables having highest loadings^ on each of the factors will be presented, and 
an attempt will be made to "interpret" or to "name" the factor in question. The 
process of Interpretation Is essentially one of trying to arrive at the most 
generalized conceptualization of the factor possible, a oonoeptualizatlon which 
will nevex'theless have utility In predicting what kinds of new measures would 
be correlated with the factor. The Interpretation of a factor is tantamount to 
a hypothesis which can be tested in further studies. 

For purposes of Interpretation, loadings of or greater in absolute 
magnitude will be considered significant. (This restriction will be relaxed 
somewhat, however. In attei^pting to Interpret the dubious factors.) When the 
loading is given with a negative sign, it means that the reverse of the variable 
in questif'4 Is correlated with the factor, or In the case of such variables as 



load Ing Is a coefficient which can be Interpreted like a correlation be- 
tween a variable and an underlying factor; it is not actn-.Uy a oorrelation, 
however. 
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"Qiaaibe? of nouns "proportion of action verbs" 5 and other neasures of fre* 
qtucDcy, lev relative freg^uenoles or proportions are associated with Mfib valveo 
of the factor in question* 

Feetor A (General Stylistic Svaluatlon?) 

In order of ssagnitude of their loadings , the following variables appear 
significantly on Factor A: 



The common element in the variables which have high loadings on factor A is 
that they are e/aluatlve s they represent a number of superficially different ways 
of saying that the style of a passage is gpo^ or bai. If a passage is rated 
good f it Is also highly llk&ly to bo rated nleaaan t ; If It is rated nl^ag^ni : 1 it 
is also lllcoly to be rated graceful , strong ^ Interostlng . etc. Any discrimina- 
tion among these terms wculd presuTably b© expected to show up In differential 
loadings on other factors, but the interesting thing is that with minor exceptions 
the scales Hated above do not annear loaded on other fact ora . As applied to 
English prose passages, the terms good . r>lc? ag.nt, /gracefu l, p trong , 
varied . clea rs origin ^1 . ordered . and sree^qq (and their opposites) are virtually 
equivalent in meaning. The texms ylvid, aieaningf al . el egant . K^ofoirnd . aur-cinct, 



good (vs. bad) 
pleasant (vs, unpleasant) 
graceful (va, awkward) 
strong (vs. weak) 

Interesting (vs. boring) 
varied (va, monotonous) 
vivid (vs, pale) 
clear (va. hazy) 
original (vs. trite) 
meaningful (vs. meaningless) 
ordered (vs. chaotic) 
precise (vs. vague) 
elegant (vs. uncouth) 
profound (vs. superficial) 
succinct (vs. wordy) 
natural (vs. affected) 



•896 

.865 

.864 

.850 

.792 

.638 

,627 

.620 

.611 




o 
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end natural ail have aa evaluatlv’e aeanlcg, but as will bo soon below, cany 
additional semantic freight as Indicated by elgnlf leant or nearly significant 
loadings on other faotors* 

It should bo borne in nlad that the results are for the averaged ratlogB 
of eight judges* It Is conceivable that Individual judges observed certain dis- 
tinctions among the tenns which might have been reflectod In different factor 
patterns had a separate factor fnalyslo been made of the ratings of each judge* 

It would be interesting to perform such analyses In order to compare the bases 
of judgment used by the several raters; yet, any differential patterning '•’*>uld 
be highly Idiosyncratic and of little use in drawirg generalisations about style* 
Our results indicate a common basis on which the judges are able to agree oon- 
oeming the meaning and application of a series of adjectival scales* 

All the significant loadings above are for the purely subjective aeasures 
of style* Apparently there are no objective measures, * at least among 

those studied here, which give any significant clue to the overall evaluation of 
prose style* One is somewhat gratified to learn this, for If style is truly a 
matter of artistic creation it will bo very difficult to Identify purely mechan- 
ical measures of style, much less to generate good stylo mechanically* There are 
to be sure, a handful of objective measures whose loadings on the evaluative 
factor approach significance; 



Number of detemlners -.27^ 
Number cf demonstrative pronouns -,206 
Nunbf'* of articles *19^ 
Number of descriptive adjectives »167 



It Is difficult, however, to make any particular sense out of these loadings; 

It Is quite likely that they reflect merely Incidental associations bstwoen sub- 
jective and objective moasvree* 

The results are of interest quite as uiuch f or what variables do appear 
on the evaluative factor aa for what variables dj^ appear* In interpreting a 
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factor^ it Is 'dsU to assure oneself that one's Interpretation adequately ao" 
counts for the non-slgnlf leant loadings as veil as the slgzilf leant ones* The 
subjective ratings which have non-elgnlflcoat leadings on this faotoi^ are as 
follows: 

lush (vs. austere) • <1^9 

nasoullne (vs* fesdnlne) • • • • • *1^ 

Intimate (vse remote) 096 

serious (vs. humorous) ••095 

florid (vs. plain) Og 

abstraet (vs. ccncrete) O68 

personal (vs. Impersonal) 050 

earnest l(ve. flippant) ••047 

opinionated (vs. impartial) 03I 

oomplex (vs. slirple) 023 

emotional (vs. rational) • • . . • .020 

Even though some of these adjectives may appear to have ev€^.uative overtones | we 

trust the reader will agree that as appllM semnlefl gt SiiSiSL they ara 

on the whole neutral in evaluative content. Thus, the evaluation of literary 

style seems to be quite independent of whether the passage being evaluated ie 

J^uBh or austere . mBaeuline or f eioinlne « jL^itimate or rsBiQ.t e. etc. Of course, the 

obtaining of non-slgnlf leant loadings for some of these terms may betoken the 

presence of what the statistician would call a non*llnear relationship; that is, 

it is oonceivable that good style Is that which is neither lush nor austere. 

neither aaBeuline nor feminine ^ neither Intimat e nor remote. The presence of 

non*linear relationships Is not detected by conventional factor analysis tech* 

yet 

niques, and there has not/ been an opportunity to search for them in the is^escnt 



Instance. 
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3>aotor B (Personal Appeal) 

Alffloet completely Independent of Factor A (the correlation Is only .16) la 

..1.4 1 niflyicr lai^ gttl 'PI ffiflut loadlnAB. 

Nunher of pronouns » ; 

Numher of persons? prcsncims . . ^ ; c 
Personal (t 3. Impersonal). . . . o 
Xnblmate (ts. remote). ..... 

Kumher of clauses .<....« 

Proportion of priisive verbs . . 

Number of CGOioion nouns • .^ . • . 

Number of preposinlons 

Nvsmber of syllables ,...«. 

Number of asrtlcles . 

Oplonlonated (vs. Impartial) . . 

Number of poBseeslve pronouns . 

• Emotional (vs. rational) .... 

Number of Infltiitlves ..... 

Proportion of "oogaltive*' verbs . 

YlgorouB (vs. placid) . • . • • 

Number of Indefinite pronouns . 

At once it Is evident that this factor reprecsents the extent to vhioh a prose 

pasoage has what may be tenaed Personal Anneel. It Is closely similar to the 

"human interest" aspect of style for which Pieech (19^9. 1950) has developed 

measures. If anything, It can be meaBured objectively better than It can be 

rated subjectively, for the variables with the two highest loadings are objective 

measures. (It should be iflontloned, however, that these loadings are somewhat 

spurlouely inflated by the fact that one of the measures le contained In the 

other; it wee through an oversight that both of these measures wore included.) 

It ie debatable whether Factor B 1 b really a factor of style; It could be argued 

that It refers to content rather than style, and that the "personal appeal" or 

"human Interest” of a passage le chiefly a natter of what is being written about. 

While this argument 1s not vholely without merit, it Is probably inaccurate. 

Subject-matter can bo held conotant while personal appeal varies. Every writer 

for popular nmgazlnes knows very well a number of techniques for malntainiz^g 

the reader’s interest even in an ordinarily dull topic. If such a writer were to 



.866 

.8oU 

Veik 

.593 

.580 

-.556 

-.553 

-.528 

-.520 

-.488 

.478 

.452 

.436 

.391 

.386 

.374 

.316 
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profit from tho present study, Uc would uce a largo auiaber of pronouna, ^ecp hie 
clauses short, avoid passive verts, sutstitute pronouns for nouns wherever pos- 

slhle, eschew prepositlonaiL phrases, and nee short words, few articles (either 

• * 

definite or indefinite) and n:any InflnltJvas and ''cognitive” verts t 
Factor C (Seriousness) 

Independent of Factor A (-.065 is the correlation) tut significantly 
negatively correlated with Factor :B (-.364) is Factor C with the following highly 
loaded varlatles: 



earnest (vs. flippant) .717 

serious I(vs. humorous) ••••.. .713 

profound (vs, superficial) • • » • »573 

masculine (vs. feminine) 314 

proportion of indefinite articles. -.460 

meaningful (vs. meaningless) • • • *386 

abstract (vs. concrete) . . • • • *363 

number of indefinite pronouns. • • «306 

proportion of "action'' verts « • • -#301 



We Identify this factor as a dinenslon of "seriousness". It may refer either to 
content or to style, the seriousness and Importance of the eut Ject-mattor , 
c*' the aeriousnose and earnestness with which the subject-matter is treated. 
Writing in a light, humorcus, or flippant vein produces low scores on this 
factor. While this factor is best assessed by subjective means, there are 
several objective meaeures which correlate very eutetantially \rith i*' , as indi- 
cated above. The use of a large number of definite articles (Jha) relative to 
the number of indefinite c.rticles (a), and the use of a large number of Indefi- 
nite’ pronoir^s ( one . aoBift*l’jQdy . etc.) seem to be associated with seriousness, 
according to these results, and there are a number of other such measures with 
nearly slgnlf leant loadings, as the reader can see by searching column C of 



Table 10. 
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yaetcr D (Ornamentation) 

Factor B la almoat conrploteXy Independent of the preceding factors (the 

ccnirelations with Factors A, and C ax*e ana •Ix.O respootively ; 

and has the following variables with high loadings: 

florid (vs. plain) •«•••••• 

wordy (vs. succinct) 

lush (vs. austere) 
affected (vs. natural) •••••• 

cong9lex (vs. slm:'>le) 

Bumber of sentences In 300 words « 

Standard deviation of sentence 

length 

Proportion of common nouns which 
are preceded by the and other* 

wise unmodified 

Number of paragraphs starts^ in 

3C0 words 

elegant (vs. uncouth) 

opinionated (vs. Impartial). . . . 
l^oportlon of nouns ending In 

Gillie's suffixes 

Clause complexity Index 

Number of clauses In 300 words . . 

Proportion of "action" verbs . • . 

Number of descriptive adjectives . 

abstract (vs. concrete) 

emotional (vs. ratloird) ..... 

We call Factor 1> Ornamentation because It sesmi to repi'ooont that dimension of 

prose style which ranges from a plala ^ austere, olaple. r 

kind of writing to a florid , wordy . Jjyighi £fflSBlSS» And highly kind of 

writing. Coincidentally, omanonted vrl'y.ng is regarded as fllQgaafe vhen It Is 

alscTkSSld, but as T^t^oowth when It Is also ss shown by the loadings of 

elegant on both Factors A and B. Likewise, ornamented writing Is regarded as 

onir^lopated and emotional when It Is also neyso nsl (with loadings on Factor B) , 

but impartial and rational when it Is impersorsl . 

There axe numerous objeotl^e bieaeui^es of ornamentation: the use of long 
sentences, the use of varied sentence length, the use of many noun modlflexs, the 
use of ooD^lex clause structures, the use of nouns ending in abstraotlon*forming 
suffixes, and the use of many descriptive adjectives. Boder's adjoctlya-verb 



.730 

.719 

.622 

.599 

.554 

•.546 

.536 



-.485 

-.478 

.467 

.461 

.437 

.436 

-.434 

-.428 

.351 

.330 

.2ST 
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quotient (19^0) I0 pro*bftl)l7 In tho zB&ln & xne&sure of oimsBioxrtfi.'bloxi* 

Fae-hors ^ {Int«rpj*#tation doifatful) and F* 

Factor S- vae fotmd to Be. highly eladler to caofchor factor, cal 3 .ed Factor E’j 
hence, the higher loadings of Both these faotore are reported Belovr. Because 
of the paucity of high loadings, loadings of .20 or greater are lis'^d. 



NumBer of proper nouns * 

Proportion of noun clauses • « « • 
NumBer of determiners »••••• 

Mean tense ••#•*•••••• « •• 

Proportion of adrerBlal clauses ... 
Proportion of indefinite articles. 
Proportion of adjectival olauses . 
Proportion of transitive verBs • . 

NumBer of easmion nouns 

placid (vs. vigorous) 

NumBer of Infinitives 

NumBer of Indefinite and quantifying 

determiners 

Proportion of copulas 



pale (vs. vivid) 



£ 


E* 


.507 


-.510 


.450 


-.l »53 


.351 


.369 


.309 


.288 


.2^^ 


.261 - 


.267 


.2i»2 


,247 


.272 


.234 


>,282 


.225 


.221 


.215 


.202 


.211 


.196 


.196 


. 211 , 


•182 


.211 




.134 



It is proBaBly extremely dangerous even to attempt to interpret this factor, 



on account of the generally low size of the loadings. What hind of writing 



would have a low numBer of proper nouns, a low proportion of noun clauses, a 



high numBer of doterminers, and generally present or future tense rather then 
past? Certainly it would Be relatively colorless end pals. The scale nlaeld* 
vigorous makes a mild appearenoe on this factor, and also the scale p^tle^vlvld . 
though with a loading so low that it is of duBious significance. There ie a dim 
poseiBility, nevertheless, that this factor represents a dimension of colorless** 
ness vhioh is independent of and different from Factor S>, Ornamentation. The 
presence on this factor of ouch variables as the Proportion of indefinite article a 
and the NumBer of indefinite and quantifying determiners lends support to such on 



interpretation. Any interpretation whatsoever, however, must Be advanced with 
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mast caution and vo era protobly visa to leaVa the xnatter for further InveBtied- 
tion, 

I'ac tcr F (Zjaterpretation dubious) 

Feotor F has the following loadings greater than *201 



Proportion of traxieltlve rerba. • • »603 

Proportion of copulas ••••••« **«377 

Proportion of intransitive verbs, • -,544 
Proportion of nouns with Gillie's 

suffixes , • • *318 

Proportion cf adjective clauses , . -,306 

tlunbor of syllables • ,294 

Proportion of Iatin-Gz*eelc derived 

verbs 292 

Number of indefinite pronouns • • • *,268 
Proportion of unmodified ooumon 

nouns **,282 

Proportion of pareuthetioal clauses ,281 
Sntropy of tense, <262 

Number of proper nouns, ,,.,,, , 26 l 

Number of articles *,24^ 

Number of gerunds ••,#•••,• *229 
Number of dotermlnorB ,,,,,•, •,2?.4 
Clause oomplezity index 209 



It is q,uite possible that this factor is largely artif actual. Since the pro* 

portions of transitive and Intransitive verbs and of copulas are figured from tbs 

oonmon base of all verbs ^ they oan hardly vary with complete independence! and it 

io in fact inevitable that at least one inverse relationship will exist. This 

fact undoubtedly explains the preseuos of the first three variables at the top 

of the list above! transitive verbs varying inversely vlth copulas and vltb in* 

• 

transitive verbs. Yeti the presenoe of transitive verbs is evidently oomrlated 
with several other variables vhers tho relationships cannot be spurious t for 
example! with the presence of nouns vlth Gillie's suffixso! vlth the preosnoe of 
adJaotlTs olaussB! and so on. At ths moment! howeveri it le difficult to dsrlre 
any meaningful Interpretation from these findings! and as In ths ease of Faotor fi 
it is probably vise to leave the faotor uninte??preted. 
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BISGOSSION 

It ia adsatixnee aald of factor analjale atudlaa that ona Aota out of them 
onljr what ona puts into them, the implication being thht auch studiea rare3;ir do 
more than confirm obyloua cluateringa of Tariablea* In the preeent oaae, the 
vrlter feels that hie original hypotheaea vore conoiderably knocked about dy tlv 
data. It vlU be recalled that in embarkiiig on the study the vriter net forth 
seven hypothetical dlmenaiona of stylo, that le, those indicated in Thble It 

r 

ia intereating to notice vhat happened to these hypothoeized diiaensiona: 

1* Aenthetie gualltv t Three of the eoales covered here, graoef nl*avk^^ard . 
?M "good f and nleaean t ^ impleasant « appesTod ae virtually pure moaaurea of factor 
A, denerai Stylistic Evaluation* The ^potheaia of a dimension of aeathetic 
quality vae therefore in some neaauz'e oonflrmed, but it vaa too specific, aineo 
Faotox** A incorporated scales from several other hypothesized dinensionB. The 
scale ungoutl^-eaeAant vaa found to be a compcsite of Factor A, General Styllstio 

Evaluation, and Factor B, Ornamentation. That is, to auy that a passage is 

» 

elegant is to say that it ia both stylistically good and omomented* 

S* Conmunicatiyenees * The hypctheiis of a factor of ooBiaunicativeness vaa 
not confirmed* All the scales hypothesized for such a factor turned out to be 
measures of Factor A, General Styllstio Evaluation* One soale, aueolnQt *v orSv . 
had a aupplementary negativo loading on Factor D, Ornamentation, i*e«, suoolnot** 
neaa leads to good style but to a lov degree of ornamentation* The Mmainlng 
scales, ohaotjo -ordered f vague *» nreoioe . proved to be simply 

variant vaya of evaluating the general style of a passage* Apparently our Judgoo 
equated good style vlth orderednees, clarity, and preoision* Good style oopum- 
loates, if it does nothing else* 

Variety. This hypothesized dliaension seems to correspond to a ooneid- 
arable extent to Factor D, Ornamentation, on which throe of the scales originally 
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& 80 l^'ifd to variety were found: florld-olain . j^un l ^^auatare . and oCTaclex-elmpIft . 
The other three acalee orlelcally aeaigned here wound up on Factor A, Goneral 

1EtrAlie«r.4 ^ f 1 ei4* 4u» nwi ^ 

.p' WiiBiiAffm# JiAAifar"f?rAi mummp mmfmit miM viMiia wmk Aiaip 

these three scales repreeentinf:> evidently^ further oharacterlstios of *'good" 
8tyle<. It is noteworthy that on the whole the ,1vdges did not diatingulsh he* 
tween clarity and variety* (At least, this is the oonolusion to ho drawn from 
the factor analyels results; a closer Inspection of the actual correlations, 
however, suggests that the fudges did distinguish hstwoen clarity and variety, 
and furbhor suggosts that the factor rotations were not as satisfactorily aocem- 
plished hy the analytical criterion as might he desired. For this reason, oer* 
tain aspects of the present analysis muct still he regarded as tentative*) 

V-iaor . This bypothools failed to he oonfinaed* Of the scales originally 
r.:t forth, two (vjvld-pple and atrong * weaV ^ emerged on the general evaluative 
.^Tactor, one (maaeullne - f em5 nine ) turned up on the "serlouaness” factor, and one 
(t>laeid*vlgoroue ) proved to he exceedingly coiaplez, with signifloant or nearly 
signiflosnt loadings on all four of the intarpretahle factors. 

guinor . This hypothesis was confirmed in the sense that both of the 
scales hypothesized for this factor appeared on a "seriousness” factor. This 
faotor, however, proved to he of greater extent than originally helloved. 

6* Eerflcnal Anneal , Tais hypothesis was well oonfirsnod, at least to the 
extent that two of the scales (la^2Kia'2!&Sfiifea e®d lii aerflQnal*^?^ ^ ^ ^ ) served 
to define a "personal appeal” factor In the ultimate analysis. It turned out, 
however, that the scale natu:ral, *affeohed was not properly placed under Personal 
Appeal, hut belonged rather to Factor 2), Omtunentation. 

7 * Affective To ne. This hypothesis was not oonfirxaod. The two scales orlg* 
inal3y placed here t\>med out to he opposite measTn:>cs of both Factor B, Porsosal 
Appeal, and Factor B, Ornamentation. 
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Tbe results of this study are also of ioterost In throvring light on oertain 
concepts of style which psychologists hare teen attenpting to define* One of 
these is tbe concept of ahstraetneae . which has teen postulated as a dinenei^ 
which affects ease of oonprehension and speed of learning. Our results show 
that this is actually a ccnposlte irarlahle? our rating of ahstraotnesc has 
loadings on both the ''eerlousnoss'* factor and the ‘ omasnentation” factor. This 
means that a passage is rated as abejbract in the degree to which it is also 
rated as both flarloua and florid . It is q.vite reasonable to suppose that ser- 
iousness and omasientatlon (’Vordinoss”) could independently influence such 
Tariables as ease of comprshensloa and speed of learning. 

A T?ynolQ<ar.Qf_^ty.lfi. 

It should be possible to use the dimensions isolated in this study as a 
o -sis for "typing” literary styles, somewhat in the manner of Sheldon’s "aomato- 
Ijypiug” of bodl^ types. Where Sheldon uses three dlmenoloas, we would use four. 
Pm? oon^cnienoe, we will use only eoleoted subjeotlve rating soalea, one from 
each of the four chief factors wo hare Identified, except that Pootor A will be 
repreoentad by two scales beoause of tho possibility that the domain of ewal* 
uatlon has not been adeawately delineated by bhe factor analyslo at the present 
stage of oouputationSc Jxl the table below, we present the averaged subjootive 
ratings on each of five soales for eaoh of 8 passages from our "sub-oub-troaeury." 



Appendix B 
hi 



Average ratings (eoale 1 to 7) 



Sample (300*vord 
passage seleoted from!} 


Vivid 


(A) 

TO*oftie© 


(B) . (C) 

narflonel serious 


(B) 

florid 


1^ Blackwood 9 Diary g 

Nursinff Sister on the 
Western F!*ont 


6.9 


6.2 


6.11 


6.7 


2.8 


21 K. Burke. A Oramnflr <?f Motives 


2.2 


1.6 


2.0 


6.3 


4.7 


A will (leged document) 

flj 

49 Fitzgerald ^ Blnmond as the Bits 

A 


2.3 


4.2 


2.7 


6.5 


*^.4 


6.4 


5.5 


4.6 


4.3 


6.2 


w e 

62 Barrio. Uncle Bemus 


6.4 


5.2 


5.6 


1.9 


4,8 


131 Stracher. Elluibeth and Essex 


5.7 


5.7 


3.7 


6.2 


4.8 


229 Stein, SkJa, gwwe. 


5.4 


4.3 


5.8 


5.3 


2.9 


139 Twain. ffiioldLoberry Fliin 


7.0 


6.5 


6.5 


4.8 


4.3 



While paeengee e^em to Be quite well and ^^aeonably differentiated jiy the 
ratings^ it can hardly be olaloed that all the Idlosynorasiee of style have been 
neaeured. l:i?he fom* dinenelons of style ve have identified do not sufflolent!ly 
veil dlsoriminate^ say^ between the passage from Gertrude Stein and the passage 
from a nursing sister's diary ^ but nevertheless the main trends are evident. 

In the present discussion ve have attenpted only to describe the more oon- 
spiouous relationships in our results. As has been indicated » some further 
statistioal troatment of the data is oallod for. It voidd not be apptoprlate at 
this juncture to go very far in drawing from these results io^lioations for 
pedagogy^ oritioismi ooimqunloaticn theory^ and such, for, as is so often the oaf^c . 
the investigation ashs more questions than it anowors. 
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